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Abstract 



This thesis has three goals related to the automorphism groups of finite p-groups. The 
primary goal is to provide a complete proof of a theorem showing that, in some asymptotic 
sense, the automorphism group of almost every finite p-group is itself a p-group. We originally 
proved this theorem in a paper with Martin; the presentation of the proof here contains 
omitted proof details and revised exposition. We also give a survey of the extant results 
on automorphism groups of finite p-groups, focusing on the order of the automorphism 
groups and on known examples. Finally, we explore a connection between automorphisms 
of finite p-groups and Markov chains. Specifically, we define a family of Markov chains on 
an elementary abelian p-group and bound the convergence rate of some of those chains. 
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Notation and Terminology 

Let G be a group. 

• li x,y & G, then [x, y] — x~^y~^xy. 

• G'^[G,G] = {[^M ■■ x,yeG) 

• Z{G) = the center of G 

• ^{G) — the Prattini subgroup of G 

• Inn(G') = the group of inner automorphisms of G 

• Out(G) = Aut(G)/Inn(G) = the group of outer automorphisms of G 

• Gn — the cychc group on n elements 

• d{G) ~ the minimum cardinahty of a generating set of G. If G is a free group, then 
d{G) is called the rank of G. If G is a finite elementary abehan p-group, then d{G) is 
the dimension of G as an Fp- vector space and thus is called the dimension of G. 

• GL{d, ¥g) = the general linear group of dimension d over the finite field 

• [^] ^ = the Gaussian (or g-binomial) coefRcent. This equals the number of /c-dimensional 
subspaces of an F^-vector space of dimension n. 

• Gnio) — the Galois number. This equals the total number of subspaces of an F^- vector 
space of dimension n. 
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Chapter 1 
Introduction 



For any fixed prime p, a non-trivial group G is a p- group if tlie order of every element of 
G is a power of p. Wlien G is finite, tliis is equivalent to saying tliat the order of G is a 
power of p. The study of p-groups (and particularly finite p-groups) is an important subfield 
of group theory. One motivation for studying finite p-groups is Sylow's Theorem 1, which 
states that if G is a finite group, p divides the order of G, and is the largest power of p 
dividing the order of G, then G has at least one subgroup of order p". Such subgroups are 
called the Sylow p-subgroups of G. The fact that G has at least one Sylow p-subgroup for 
each prime p dividing the order of G suggests that in some heuristic sense, finite p-groups 
are the "building blocks" of finite groups, and that to understand finite groups, we must first 
understand finite p-groups. This thesis studies the automorphism groups of finite p-groups, 
but this introductory chapter begins with a description of two other aspects of finite p-group 
theory, both to give a sense for what p-group theorists study, and because they are relevant 
to the main question addressed in this thesis. 

It turns out that understanding finite p-groups (whatever that means) is quite hard. 
Mann [68] has a wonderful survey of research and open questions in p-group theory. Much 
of the research relies on a basic fact about finite p-groups: they are nilpotent groups. A 
group G is nilpotent if the series of subgroups Hq = G, Hi = [G,G], H2 = [Hi,G], . . . , 
eventually reaches the trivial subgroup. Here, [Hi,G] denotes the subgroup of G generated 
by all commutators consisting of an element in Hi and an element in G. If m is the smallest 
positive integer such that Hm is trivial, then we say that G is nilpotent of class m, or just of 
class m. When G is a finite p-group and the order of G is p", the class of G is at least 1 and 
at most n — 1. Finite p-groups of class 1 are the abelian p-groups, and those of class n — 1 
are said to be of maximal class. 

One triumph in finite p-group theory over the past 30 years has been the positive res- 
olution of the five coclass conjectures via the joint efforts of several researchers. While we 
have no hope of a complete classification of finite p-groups up to isomorphism (see Leedham- 
Green and McKay [5^ Preface]), the coclass conjectures do offer a lot of information about 
finite p-groups. Mann [BSl Section 3] has a short discussion of the subject, and the book 
by Leedham-Green and McKay [59] is devoted to a proof of the conjectures and related 
research. We will state only one of the conjectures here. The coclass of a finite p-group of 
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order and class m is defined to be n — m. The coclass Conjecture A states that for some 
function f{p,r), every finite p-group of coclass r has a normal subgroup K of class at most 
2 and index at most f{p, r). If p = 2, one can require K to be abelian. 

Another aspect of p-group theory is the enumeration of finite p-groups by their order and 
related questions, as described in Mann [HSl Section 1]. Let g{k) equal the number of groups 
of order at most k, let gnii{k) equal the number of nilpotent groups of order at most k, let 
gp{k) equal the number of ]9-groups of order at most k, and let gp^2{k) equal the number of 
p-groups of order at most k and class 2. It is known that 

It is an open question as to whether or not 

lim ^"i''^^) = 1- 
k^oo g(k) ' 

if so, it would imply that most finite groups are 2-groups. Pyber [81] has shown the weaker 
result that 

log^nii(/i;) T 

hm — — = 1. 

fc^oo log(?(/e) 

Higman [41j and Sims [85j show that gp{p^) and (7p,2(p") are both given by the formula 
p(2/27)fc^+o(fc3) ^^gjj^g little-oh notation). It is an open problem to evaluate 

lim 



It is possible that the limit is 1 and that most p-groups have class 2. 

This thesis explores the structure of the automorphism groups of finite p-groups and the 
connections between these automorphism groups and other topics. There are three principal 
goals. The first goal is to prove Theorem 12. 11 which says that, in a certain asymptotic sense, 
the automorphism group of a finite p-group is almost always a p-group. A weaker version of 
this result was announced by Martin in [BH] , and Helleloid and Martin [32] prove the general 
result. The presentation of the proof in this thesis contains some omitted proof details and 
revised exposition. 

There are many reasonable asymptotic senses in which one could ask if the automorphism 
group of a finite p-group is almost always a p-group. The most obvious is to sort p-groups 
by their order as in the above questions about the number of p-groups. Nilpotence class is 
another important invariant that one might consider, while the coclass conjectures suggest 
that an approach using coclass might be more successful. As it happens. Theorem 12.11 does 
not use any of these parameters, instead turning to the minimum cardinality of a generating 
set of the p-group and an invariant known as the lower p-length. While it would be of great 
interest to prove analogous theorems using the invariants suggested above, it seems that the 
proofs would require very different machinery. 



8 



Chapter [2] contains a statement of Theorem 12.11 and an outhne of the proof, while Chap- 
ters [3] through E] and Appendix [X] complete the full proof. The proof relies on a variety 
of topics: analyzing the lower p-series of a free group via its connection with the free Lie 
algebra; counting normal subgroups of a finite p-group; counting submodules of a module 
via Hall polynomials; and using numerical estimates on Gaussian coefficients. Some of the 
intermediate results may be of independent interest, including Theorems 14.121 [STTl and 16. 1[ 

The second goal of this thesis is to survey much of what is known about the automorphism 
groups of finite p-groups. The latter part of this introductory chapter discusses what is 
known in general about these automorphism groups. Chapter [7] focuses on three other 
topics: explicit computations on the automorphism groups of finite p-groups; constructions 
of finite p-groups whose automorphism groups satisfy certain conditions; and examples of 
finite p-groups for which it is known whether or not the automorphism group is itself a 
p-group. 

There are aspects of the research on the automorphism groups of finite p-groups that 
are largely omitted in this survey. We mention three here. The first is the conjecture that 
|G| < |Aut(G)| for all non-cyclic finite p-groups G of order at least p^. This has been verified 
for many families of p-groups, and no counter-examples are known; there is an old survey 
by Davitt [T^]. The second is the (large) body of work on finer structural questions, like 
how the automorphism group of an abelian p-group splits or examples of finite p-groups 
whose automorphism group fixes all normal subgroups. The third is the computational 
aspect of determining the automorphism group of a finite p-group. Eick, Leedham-Green, 
and O'Brien [26] describe an algorithm for constructing the automorphism group of a finite 
p-group. This algorithm has been implemented by Eick and O'Brien in the GAP package 
AutPGroup [28j. There are references in [26] to other related research as well. 

There are a few survey papers that also summarize some results on automorphism groups. 
Corsi Tani [13] gives examples of finite p-groups whose automorphism group is a p-group; 
all these examples are included in Chapter [7] along with some others. Starostin ^87J and 
Mann [68] survey open questions about finite p-groups, and each include a section on au- 
tomorphism groups. In particular, Starostin focuses on specific examples related to the 
IGI < |Aut(G)| conjecture and finer structural questions. 

The third goal of this thesis is to explore a connection between the automorphisms 
of a finite p-group and random walks. Chapter [8] focuses on computing the convergence 
rate of a certain Markov chain on a finite abelian p-group that has been "twisted" by an 
automorphism. Appendix [B] contains numerical estimates used in this computation. The 
introduction to Chapter [8] briefiy mentions the appearance of automorphisms of p-groups in 
two other contexts, namely projections of random walks and supercharacter theory. 

We conclude this introduction with some general results about the automorphism group 
of a finite p-group, for the most part following the survey of Mann [68] . First, we can 
identify three subgroups of Aut(G') which are themselves p-groups. The inner automorphism 
group Inn(G') is trivially a p-group. More interestingly, let Autc(G') be the automorphisms 
of G which induce the identity automorphism on G/Z{G) (where Z{G) is the center of G), 
and let Autj(G) be the automorphisms of G which induce the identity automorphism on 
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G/^{G) (where is the Frattini subgroup of G, defined as the intersection of all maximal 
subgroups of G). Then Autc(G') and Aut f{G) are p-groups, both of which contain Inn(G'). 
More results on Autc(G) are given by Curran and McCaughan |17]. 

The next result is a theorem of Gaschiitz [30j, which states that all finite p-groups G 
have outer automorphisms. Furthermore, unless G is cyclic of order p, there is an outer 
automorphism whose order is a power of p. It is an open question of Berkovich as to whether 
this outer automorphism can be chosen to have order p. Schmid [84J extends Gaschiitz' 
theorem to show that if G is a finite nonabelian p-group, then there is an outer automorphism 
that acts trivially on Z{G). Furthermore, if G is neither elementary abelian nor extraspecial, 
then Out(G) has a non-trivial normal p-subgroup. Webb [91] proves Gashiitz's theorem and 
Schmid's first generalization in a simpler way and without group cohomology. If G is not 
elementary abelian nor extraspecial, then Miiller [71] shows that Aut/(G) > Inn(G). 

As mentioned earlier, one prominent open question is whether or not |G| < |Aut(G)| for 
all non-cyclic p-groups G of order at least p^. A related question concerns the automorphism 
tower of G, namely 

G = Go^Gi = Aut(Go) ^ G2 = Aut(Gi) ^ ■ ■ ■ , 

where the maps are the natural maps from Gi to Inn(Gj). For general groups G, a theorem of 
Wielandt shows that if G is centerless, then the automorphism tower of G becomes stationary 
in a finite number of steps. Little is known about the automorphism tower of finite p-groups. 
In particular, it is not known whether or not there exist finite non-trivial p-groups G other 
than Ds with Aut(G') = G. 
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Chapter 2 



The Automorphism Group is Almost 
Always a p- Group 

Over the next five chapters, we will prove that, in some asymptotic sense, the automorphism 
group of a finite p-group is almost always a p-group. This chapter begins with some ex- 
amples of automorphism groups of finite p-groups and related computational data. All of 
the examples are discussed in greater detail in Chapter [3, which is a survey of results on 
the automorphism groups of finite p-groups. We continue with a precise statement of the 
main theorem. Theorem 12.11 as well as an outline of the proof. The following chapters (and 
Appendix |A]) give the details of the proof. A weaker version of this result was announced by 
Martin in ^69j|, and Helleloid and Martin [39] prove the general result. 

2.1 Examples and Computational Data 

The claim that the automorphism group of a finite p-group is almost always a p-group may 
not seem entirely plausible, since many common finite p-groups have an automorphism group 
that is not a group. The first finite p-groups that spring to mind are probably the abelian 
ones. Any finite abelian p-group G is isomorphic to C^x^ x C^aj x ■ ■ ■ x C^Xf, for some 
choice of integers Ai > A2 > ■ ■ ■ > A/,. > 0, where Cm denotes the cyclic group of order m. 
Macdonald Chapter II, Theorem 1.6] offers an exact formula for the order of Aut(G) in 
terms of Ai, A2, . . . , A^ which shows that Aut(G) is a p-group if and only if p = 2 and the 
integers Aj are not all distinct. 

Another family of finite p-groups consists of the Sylow p-subgroups G of the general linear 
groups over Fg, where g is a power of p. Pavlov [80] and Weir [91] offer an explicit description 
of the automorphisms of G and an exact determination of the structure of Aut(G) in terms 
of semi-direct products of elementary abelian and cyclic groups. It follows from their work 
that Aut(G') is a p-group if and only if p = g = 2. 

A third family of finite p-groups familiar to group theorists consists of the extraspecial 
p-groups. These are the nonabelian p-groups G whose center, commutator subgroup, and 
Frattini subgroup are all equal to each other and isomorphic to Cp. Winter [97J shows that 
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Aut(G') = H K (6), where 6 is an automorphism of order p — 1 and the quotient of H by the 
(elementary abehan) inner automorphism group of G is a certain subgroup of a symplectic 
group. As a consequence, Aut(G) is not a p-group for any prime p. 

Besides these exphcit examples of automorphism groups which are not p-groups, Bryant 
and Kovacs [lOj show that any finite group occurs as a certain quotient of Aut(G) for some 
finite p-group G. Of course, if this finite group is not a p-group, then Aut((j>') will not be a 
p-group. But in the course of proving the main theorem, we will show that the quotient in 
question is in fact almost always trivial. 

Finding finite p-groups whose automorphism group is a p-group is reasonably easy when 
p = 2 and quite difficult when p > 2. In the case of p = 2, as mentioned before, if G is an 
abelian 2-group and (in the notation used above) the integers Aj are not all distinct, then 
Aut(G') is a 2-group. The automorphism group of the dihedral 2-group (for ^ > 3) is 
the 2-group C^„-i x Gg"^. The automorphism group of the generalized quaternion 2-group 
(^2" (for n > 4) is the 2-group C2n-i ix (C2n-3 x C2) (see Zhu and Zuo |100j ). Newman and 
O'Brien [77] offer three more infinite families. 

When p > 2, the known examples of finite p- groups whose automorphisms groups are 
p-groups are much more complicated. In [15], for every integer n > 2, Horosevskii constructs 
such a p-group with class n and, for every integer d > 3, constructs such a p-group that is 
minimally generated by d elements. Furthermore, Horosevskii shows in ^S] and [IB] that 
for any prime p, if Gi,G2, ■ ■ ■ ,Gn are finite p-groups whose automorphism groups are p- 
groups, then the automorphism group of the iterated wreath product Gi I G2 I ■ ■ ■ I Gn is 
also a p- group. The other known examples arise from complicated and unnatural-looking 
constructions (see Webb [^2])- As previously mentioned. Chapter [7] offers a more detailed 
survey of the automorphism groups of specific p-groups. 

In a computational vein. Kick, Leedham- Green, and O'Brien [SB] describe an algorithm 
for constructing the automorphism group of a finite p-group. This algorithm has been 
implemented by Kick and O'Brien in the GAP package AutPGroup [28j. Compiled with 
the gracious help of Eamonn O'Brien (personal communication) and the GAP packages 
AutPGroup and SmallGroups [28], Table \2A] summarizes data on the proportion of small p- 
groups whose automorphism group is a p-group. (More information about the SmallGroups 
package can be found in Besche, Kick and O'Brien [7J.) Our ability to compute the massive 
amount of data encapsulated in Table 12.11 is a testament to the power of the AutPGroup 
algorithm. 

Table 12.11 does not offer enough data to make any firm conjectures, but we can make 
some observations. First, the behavior for p = 2 and for p > 2 seems to be different; the 
proportions in the table for p = 2 are much higher than for p > 2. We have no explanation 
for this other than the naive guess that p-groups "often" have automorphisms of order p — 1, 
which prevents the automorphism group from being a p-group unless p = 2. The second 
observation is that for 2 < p < 5 and 3 < n < 7, the proportion shown in the table is a 
non-decreasing function of n. Finally, for 3 < p < 5 and 3 < n < 7, the proportion shown in 
the table is a non-decreasing function of p. 

Again, this is hardly enough data to make any conjectures, but we might begin to hope 
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Order 


p=2 


p = 3 


p = 5 




3 of 5 


of 5 


of 5 


4 

p 


9 of 14 


of 15 


of 15 




36 of 51 


of 67 


1 of 77 


p6 


211 of 267 


30 of 504 


65 of 685 


7 

p 


2067 of 2328 


2119 of 9310 


11895 of 34297 



Table 2.1: The proportion of p-groups of a 
given order whose automorphism group is 
a p- group. 



that the proportion of p-groups of order whose automorphism group is a p-group tends 
to a hmit as p or n goes to infinity, and perhaps even that the hmit is 1. These questions 
remain open (see Mann [681 Question 9]). Indeed, our main theorem does show that the 
automorphism group of a finite p- group is almost always a p-group, but the asymptotic sense 
in which we mean "almost always" does not refer to the order of the group. The next section 
will explain what we mean by "almost always" and will state the main theorem. 

2.2 The Main Theorem 

The precise statement of our theorem depends on the lower p-series of a group. The lower p- 
series of a group G is the descending series of subgroups Gi > G2 > ■ ■ ■ defined inductively 
by Gi = G and Gj+i = G^[G,Gi]. Here, Gf is the subgroup generated by p-th powers 
of elements of Gi, and [G, Gi] is the subgroup generated by commutators consisting of an 
element from G and an element from Gi. Section 13.11 explores the properties of the lower 
p-series in more detail; for the moment, it suffices to know that each Gi is a characteristic 
subgroup of G and that the quotients Gj/Gj+i are all elementary abelian p-groups. Since 
Gi/Gi+i is an elementary abelian p-group, it is also an Fp- vector space, and we will refer 
to the dimension dim(Gj/Gj+i) of Gj/Gj+i when we mean the dimension of Gj/Gj+i as an 
Fp-vector space. We say that G has lower p-length n if the number of non-identity terms in 
its lower p-series is n. Also, for any group G, we let d{G) denote the smallest cardinality 
of a generating set of G. As we will see later, every p-group G with lower p-length n and 
d{G) = d is finite, and there are finitely many such p-groups. Finally we can state the main 
theorem. 

Theorem 2.1. Let rp fi.n be the proportion of p-groups G with lower p-length at most n and 
d{G) = d whose automorphism group is a p-group. If n > 2, then 

lim rp^d,n = 1- 

d— >oo 

Ifd>5, then 

lim rp^d,n = 1- 

n— >oo 
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// one of the following conditions is satisfied: 



• n = 2, 

• n > 3 and d > 17, 

• n > A and d > 8, (2.1) 

• n > 5 and d > 6, or 

• n > 10 and d > 5, 

then 

lim rp^d,n = 1- 

p— >oo 

Some of the given conditions on d and n are necessary. For example, the only p-group 
with lower p-length 1 and d{G) = d is Cp, so rp^d,i = for p > 2 or > 1. Similarly, the 
only p-group with lower p-length n and d{G) = 1 is Cpn, so i „ = for p > 2 or n > 1. 
However, it is not clear what conditions on d and n are absolutely necessary in Theorem 12.11 



2.3 An Outline of the Proof of the Main Theorem 

The proof of Theorem 12.11 breaks down into three parts, which are presented in Chapters [3l 
El and El and are assembled to prove Theorem 12.11 at the end of this chapter. In this section, 
we will outline the structure of the proof. 

The first step is to connect the enumeration of finite p-groups to an analysis of certain 
subgroups and quotients of free groups. In fact, we will prove bijections between certain 
families of finite p-groups and certain orbits of subgroups of a free group. Let F be the free 
group of rank d and let Fn be the n-th term in the lower p-series of F. It turns out that 
the action of Aut(F/F„+i) on the vector space Fn/Fn+i induces an action of GL((i, Fp) on 
Fn/ Fn+i, and the Aut(F/F„+i) -orbits on the subgroups of F/Fn+i lying in Fn/ F^+i are also 
the GL((i, Fp)-orbits. We say that an orbit is regular if it has trivial stabilizer, that is, if the 
size of the orbit equals the size of the group that is acting. 

For any finite p-group G, write A{G) for the group of automorphisms of G/^{G) induced 
by Aut(G), where is the Frattini subgroup of G. We shall see that if A{G) is a p-group 
then so is Aut(G*); in fact, our main goal is to prove that A{G) is almost always trivial (in 
the same asymptotic sense as in Theorem 12. II) . In Chapter [3], after defining and investigating 
the lower p-series, we prove the following theorem. 

Theorem 2.2. Fix a prime p and integers d,n > 2. Let F be the free group of rank d and 



14 



define the following sets: 



Ad,n = {normal subgroups of F/Fn+i lying in F2/Fn+i} 
Bd,n = {normal subgroups of F/Fn+i lying in F^jFn^x 

and not containing Fn/Fn+i} 
Cd,n = {normal subgroups of F/F^+i lymg m Fn/Fn+i] 
T^d,n = {normal subgroups of F/Fn+i contained in the 

regular GL{d,¥p)- orbits in C^.n} 



^d,n = {Aut{F/ Fn+i)- orbits in Ad,n} 

^d,n = {Ant{F /Fn+i)- orbits m I3d,n} 

<ld,n = {Ant{F/Fn+i)- orbits in Cd,n} = {GL{d,¥p)-orbits in Cd,n} 

2?d,n = {regular GL{d,¥p)-orbits in Cd^n}- 

Then there is a well-defined map TXd,n '■ ^d,n ~^ {finite p- groups} given by L/Fn^i ^ F/L, 
where L/F^+i G Ad,n- Furthermore T:d,n induces bijections 

^d,n ^ {p-groups H of lower p- length at most n with d{H) = d} 
^d,n ^ {p-groups H of lower p- length n with d{H) = d} 
2)d,n ^ {p-groups H in 'nd,n{^d,n) with A{H) = 1}. 

In order to understand the usefulness of this theorem, note that ^d,n is in bijection with 
finite p-groups H of lower p-length at most n with d{H) = d, and this bijection restricts to a 
bijection between Dd,n and some of these p-groups whose automorphism groups are p-groups. 
As we will see in Chapter HI F/Fn+i is a finite group, and so ^d,n is finite. Therefore the 
ratio |S)d,n|/|2td,„| is well-defined and is at most the proportion of p-groups H with lower 
p-length at most n and d{H) = d whose automorphism group is a p-group; in the notation 
of Theorem 12. ![ |2)d,„|/|2ld,„| < rp^d,n- So to prove the limiting statements about rp^d,n from 
Theorem 12. H it suffices to prove the same limiting statements about |2)d_„|/|2t(i,„|- We state 
this formally as a corollary of Theorem 12.21 



Corollary 2.3. Suppose that 
for n>2, 
for d > 5, and 



ID 



d,n 



lim 

^'^d,n\ 



lim 

n— »oo 



lim 



|2td,„| 



for d and n satisfying one of the conditions in Ii2.1\) . Then Theorem \2.1\ is true. 
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We will prove the hypotheses of Corollary 12. 3l in two steps. Namely, we will show that the 
ratios |Cd,„|/|2lrf^n| and |2Dd,n|/|'^d,n| satisfy the same limiting statements (using the results 
of Chapters O and E] respectively), and therefore so does the ratio |S)rf^„|/|2lrf^„|. Both of 
these steps require some knowledge of the structure of Fn/Fn+i. In Chapter HI we prove that 
Fn/Fn+i is isomorphic (as a FpGL((i, Fp)-module) to part of the free Lie algebra over Fp. 
In particular, this lets us use the combinatorics of the free Lie algebra to compute certain 
parameters of the group F/Fn+i (see Corollary I4.13p . 

To prove that the ratios |Cd,ri|/|2ld_„| and |S}rf^„|/|€d^„| satisfy the desired limiting state- 
ments, we obtain explicit lower bounds for each in Theorems 12.41 and 12.61 respectively. To 
state these bounds, we define, for any number a; > 1, the quantities 

oo oo _ 

C{x) = and D{x) = n Y^^- (2-2) 

r=— oo j=l 

Theorem 2.4. Fix a prime p and integers d and n so that either n > 3 and d > 6 or n > 10 
and d > 5. Let F be the free group of rank d and let di he the dimension of Fj/Fj+i for 
i = 1, . . . ,n. Then 



Corollary 2.5. If n>2, then 
Ifd>5, then 



I ^d,n I 



1. |^d,ri| -I 



1 . ^d,n -, 
n^oo \Vid,n\ 



If d and n satisfy one of the conditions in ^2. then 

1 . ^d,n -, 
hm -r-r^ = 1 

Theorem 15.11 gives an upper bound on the number of normal subgroups of a finite p-group, 
and the proof of Theorem 12.41 applies this theorem to the quotient F / F^+i. Corollary 12.51 will 
follow using bounds on dn from Lemma lA.41 showing that |(^d,n|/|2trf,„| satisfies the desired 
limiting statements. 

Theorem 2.6. Fix a prime p and integers d and n so that either n = 2 and d > 10 or 
n > 3 and d > 3. Let F be the free group of rank d and let di be the dimension of Fi/Fi^i 
for i = 1, . . . ,n. Let 



Cl 



C{pfD(j))Y'^^^ ■ n = 2 and d> 10 
C{p)^D{p)p^/^ : n > 3. 
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n = 2 
n> 3. 



Let 

Then 
(a) 

(b) 



1 ^d,n 


■|GL(rf,Fp)| 









Corollary 2.7. If n>2, then 



Ifd>3, then 



\^d,n\ 1-CiP' 



1. I'^d.nl -, 
d-*co \<Lii,n\ 



T \'^d,n\ 

lim = 1. 



iC2 



If n = 2 and d > 10, or n > 3 and d > 5, or n > 4 and d > 3, then 

lim 



P^oo \(td,n\ 

In proving Theorem 12.61 we use the Cauchy-Frobenius Lemma to estimate by 
analyzing the submodule structure of Fn/Fn+i as an FpGL((i, Fp)-module. As part of this 
analysis, we use the theory of Hall polynomials to count the number of submodules of fixed 
type of a finite module over a discrete valuation ring. Corollary 12 . 71 will follow using bounds 
on dn from Lemma [A. 4[ showing that |2Drf^n|/|£d^n| satisfies the desired limiting statements. 

In stating Theorems 12.41 and 12. 6[ we have judged it more satisfactory to give explicit 
numerical bounds, even though the proof of Theorem 12.11 requires only asymptotic bounds. 
However, since we have no expectation that our proof method gives bounds that are sharp, 
we have opted for (relatively) clean explicit bounds rather than the best possible. 

Appendix |X] contains combinatorial estimates, including bounds on Gaussian coefficients, 
that are needed in Chapters E] and O 



2.4 Concluding Remarks on the Main Theorem 

In this section, after formally proving Theorem 12. II by citing results from the previous section, 
we will state some minor variants and consequences. 
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Theorem 12.11 Let Tp^d^n be the proportion of p- groups G with lower p -length at most n and 
d{G) = d whose automorphism group is a p-group. Ifn>2, then 

lim rp^d,n = 1- 

Ifd>5, then 

lim rp^d,n = 1- 

n^oo 

// one of the following conditions is satisfied: 

• n = 2, 

• n > 3 and d > 17, 

• n > A and d > 8, 

• n > 5 and d > Q, or 

• n > 10 and d > 5, 

then 

lim rp^d,n = 1- 

p— >oo 

Proof. This follows directly from Corollaries 12.31 12.5[ and 12.71 □ 

Corollary 2.8. Let Sp^d,n be the proportion of p- groups G with lower p- length at most n and 
d{G) < d whose automorphism group is a p-group. If n > 2, then 

hm Sp^d,n = 1- 

d— ►oo 

Proof. This follows directly from Theorem 12.11 and the trivial observation that while the 
number of p-groups generated by at most d elements and with lower p-length at most n is 
finite, the number of p-groups with lower p-length at most n is infinite. □ 

Corollary 2.9. Let tp^d,n be the proportion of p-groups G with lower p- length n and d{G) = d 
whose automorphism group is a p-group. Ifn>2, then 

lim tp^d,n = 1- 

If d > 5, then 

lim tp^d,n = 1- 

n— >oo 

// d and n satisfy one of the conditions in \2.1l then 

lim tp^d.n = 1- 

Proof. The number of p-groups G with lower p- length n and d{G) = d is \^d,n\, so tp^d,n > 
|S?d,n|/|23d,„|. AsDrf,„ C ^d,nlJ{Fn/Fn+i} C 2td_„, it foUows from Theorem O that i\'3d,n\ + 
l)/|25d,n| 1 ioT each of the limits (with corresponding conditions on d and/or n) in 
question. Since \'^d,n\ ^ oo in each case. Theorem 12. II implies that |S)d,ri| ^ cxo as well. This 
proves that |23(i,„|/|2)d,n| 1 for each of the limits in question. □ 
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Corollary 2.10. LetUp^d,n be the proportion of p-groups G with lower p-length n and d{G) < 
d whose automorphism group is a p- group. Ifn>2, then 

lim Up^d,n = 1- 

d— »oo 

Proof. This corollary follows from Corollary 12.91 just as Corollary 12.81 follows from Corol- 
lary O □ 

Using Corollary 12.81 Henn and Priddy [50] prove the following theorem. 

Theorem 2.11 (Henn and Priddy [40j). Let Vp^d,n be the proportion of p-groups P with lower 
p-length at mostn andd{P) < d that satisfy the following property: ifC is a finite group with 
Sylow p-subgroup P, then G has a normal p- complement. Ifn>2, then lim^^oo "^p.^.n = 1- 

As mentioned earlier in this chapter, the following question remains unanswered. 

Question. Let Wp^n be the proportion of p-groups with order at mostp^ whose automorphism 
group is a p-group. Is it true that lim„^oo Wp^n = 1 ? 
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Chapter 3 

The Lower p-Series and the 
Enumeration of p-Groups 



If we hope to prove that the automorphism group of almost every p-group is itself a p-group, 
there are two initial questions to answer: what do we mean by "almost always", and how 
do we relate the set of finite p-groups (and their automorphism groups) to something we 
can actually work with? As mentioned in Chapter [21 the answer to both of those questions 
starts with the lower p-series, a central series defined for all groups. This chapter begins 
with an introduction to the lower p-series and its basic properties. It follows with the 
connection between the lower p-series and automorphisms, and it closes with theorems on 
the correspondence between p-groups in a variety and orbits of subgroups of a free group. 



3.1 The Lower ^^-Series 



The lower p-series of a group was introduced independently by Skopin [86] and hazard [58 
It is described in detail by Huppert and Blackburn [IHl Chapter VIII] (under the name A- 
series) and by Bryant and Kovacs [TU] . It has also been called the lower central p-series, the 
lower exponent-p central series, or the Frattini series. 

The lower p-series is particularly suited to computer analysis of finite p-groups and forms 
the basis of the p-group generation algorithm of Newman [76] . This algorithm is described 
in greater detail in O'Brien [78j. It was modified in [79] and [26] to construct automorphism 
groups of finite p-groups. It should also be mentioned that results on the lower p-series 
have appeared in [26j and [75], while the link between the lower p-series and automorphisms 
described in Section 13.21 is an extension of results that Higman |41j and Sims ||85j used to 
count finite p-groups. 

Definition. Fix a prime p. For any group G, the lower p-series G = Gi > G2 > ■ ■ ■ of G 
is defined by Gj+i = G^[Gi, G] for i > 1. G is said to have lower p-length n if G„ is the last 
non-identity term in the lower p-series. 

For an example of the lower p-series, suppose that G is a finite abelian p-group. Then 
all commutators of elements in G are trivial, so Gj+i = Gf . We can say precisely what each 
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subgroup Gi is. Recall that a partition A of n is a sequence of integers Ai > A2 > ■ ■ ■ > A^ > 
such that X]j=i = n. A finite abelian p-group of order has type A if it is isomorphic to 

CpXi X Cp\2 X ■ ■ ■ X CpXf.. 

So suppose that G has type A. For each positive integer i, define a new partition A*-*^ by 
A^*"* = max {Aj — i + 1, 0} for j = 1, 2, . . . , k. Then Gi is a finite abelian p-group of type A*^*^. 
In particular, Gi is non-trivial if and only if i < Ai, and so the lower p- length of G is Ai. 

For a second example of the lower p-series, let G be the group of (n + 1) x (n + 1) upper 
triangular matrices with entries in ¥p and ones on the diagonal; this is a Sylow p-subgroup 
of GL{n + l,Fp). Then Gi consists of all matrices in G whose entry in position (j, k) is if 
< k - j < i. 

Before we list some basic facts about the lower p-series, recall that a subgroup is fully 
invariant if every endomorphism of the group restricts to an endomorphism of the subgroup. 
For any group G, we write G = 71(6*) > 72 (G) > ■ ■ ■ to denote the lower central series of 
G, where 7i+i(G) = [7j(G),G]. The following proposition states five fundamental properties 
of the lower p-series; the first four facts are proved in Huppert and Blackburn [49L Chapter 
VIII, Theorem 1.5 and Corollary 1.6] and the fifth fact is obvious by induction. 

Proposition 3.1. For any group G and for all positive integers i and j , 

1. [Gj, Gj\ < G,;+j . 

2. G\ < Gj+j. 

3. G, = 7i(GK"72(GK"'---7^(G). 

4. G j+i is the smallest normal subgroup of G lying in Gi such that Gi/Gi^i is an elemen- 
tary abelian p-group and is central in G/G^+i. 

5. Gi is fully invariant in G. 

As we will see, the fact that Gi/Gi+i is elementary abelian, and therefore an Fp-vector 
space, is a key reason we are able to prove the main theorem. It is also important that the 
lower p-length has a special significance for finite groups. 

Proposition 3.2. Let G be a finite group. Then G is a p-group if and only if G has finite 
lower p-length. 

Proof. Since the order of Gi/Gi+i is a power of p for all i, it is clear that if G is not a 
p-group, then G has infinite lower p-length. In the other direction, suppose G is a p-group. 
It suffices to show that if Gj is non-trivial, then Gj+i < Gj. Since G is nilpotent, [Gi, G] < Gi 
(see Kurzweil and Stellmacher [551 Lemma 5.1.6]). Then Gj/[Gj,G] is a non-trivial abelian 
p-group. Hence 

Gi/[G„G] > (G,/[G,,G]f = G';iG,,G]/[G,,G], 
and so Gi > G^G^, G] = G,+i. □ 
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Note that if G is a finite p-group, then G2 = ^{G), the Frattini subgroup of G (see, for 
example, Kurzweil and Stellmacher [511 Lemma 5.2.8]). As a consequence, the Burnside Basis 
Theorem says that the smallest cardinality d{G) of a generating set of G equals dim(G'/G'2), 
and that any lift to G of a generating set of G/G2 generates G. 

We are actually interested in the lower p-series of free groups of finite rank as well as 
that of finite p-groups. The reason is that the lower p-series of a finite p-group is related to 
the lower p-series of a free group in the following way. Let G be a finite p- group, and let F 
be the free group of rank d{G). Then G is isomorphic to F/U for some normal subgroup U 
of F. It is easy to see by induction that Gi = FiU/U for all i; namely, if Gi = FiU /U, then 

G,+i = {F,U/UY[F,U/U,F/U] 
^ F[[F,,F]U/U 
^ Fi+^U/U. 

It follows that the lower p-length of G is n, where Fn+i is the first term in the lower p-series 
of F that is contained in U . The lower p-series of F will be discussed in detail in Chapter HI 
but we mention here that the groups F/ Fn are finite p-groups for all n. 



3.2 The Lower /^-Series and Automorphisms 

In this section we collect some necessary facts linking the lower p-series and automorphisms. 
The first proposition is fundamental to our overall proof strategy, while the remaining propo- 
sitions are easy technical lemmas that will be used in Section 13.31 To begin, suppose that 
G is a finite p-group, and let d = d{G). Any automorphism of G induces an element of 
Aut(G/G2) = GL{d,¥p). Thus we obtain a map from Aut(G) to GL{d,¥p) and an exact 
sequence 

1 ^ K{G) ^ Aut(G) ^ A{G) 1, 

where A{G) is a subgroup of GL{d,¥p). The group K{G) acts trivially on G/G2, and hence 
on each factor Gi/Gi+i (see Huppert and Blackburn [49, Chapter VIII, Theorem 1.7]). As 
Aut(G) acts on each Gi/Gi^i and the kernel of the action contains K{G), we obtain an 
action of A{G) on each Gi/Gi+i. The following key proposition is due to P. Hall [3F, Section 
L3]. 

Proposition 3.3. If G is a finite p-group, then so is K{G). 

Proof. Suppose a G K{G) has order g, where g is a prime not equal to p or g = 1. Any 
coset XG2 of G2 in G is fixed by a, since a acts trivially on G/G2. The orbit of an element 
of a;G2 under a has size 1 or g, and |xG2| is a power of p, so some element of XG2 is fixed by 
a. Every coset of G2 contains an element fixed by a, and since G2 is the Frattini subgroup 
of G, these coset representatives generate G. Thus a fixes G and g = 1. Hence K{G) is a 
p-group. □ 

Proposition 3.4. If G is a finite p-group and a is an endomorphism of G that induces an 
automorphism on G/G2, then a is an automorphism of G. 
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Proof. The image of G under a contains coset representatives for each coset of G/G2- These 
coset representatives generate G, so the image of G under a is all of G. Hence a is an 
automorphism. □ 



Let F be the free group of rank d with free generating set ?/2, • • • , Vd- 

Proposition 3.5. IfU is a proper fully invariant subgroup of F, then U < F2 and d{F/U), 
the smallest cardinality of a generating set of F/U, equals d. 

Proof. Suppose f/ ^ F2 is a fully invariant subgroup of F. The elements y^" ■ ■ ■y'^'^, with 

< ai < p, form a complete set of coset representatives for the cosets of F2 in F, so U 
contains an element ?/ in a coset y^^ ■ ■ ■ y'^''F2 with some Oj nonzero. Then the endomorphism 

of F that sends yj to 1 for j ^ i and sends yi to yl' for some k = 1, . . . , d sends y into the 
coset ykF2. Since k was arbitrary, this shows that U contains coset representatives of ykF2 
for all k = 1, . . . ,d. These cosets generate F/F2, and so the coset representatives generate 
F. Hence U = F. 

Finally, since d{F) = d{F/F2), any normal subgroup U oi F contained in F2 satisfies 
d{U) = d. □ 

Proposition 3.6. Let U be a fully invariant subgroup of F contained in F2 and suppose that 
G = F/U is a finite p-group. Then any automorphism a of F/F2 lifts to an automorphism 
ofG. 

Proof. Since F is free, there is an endomorphism a' of F such that cr'{yi) G o'{yiF2) for all 

1 = 1, . . . ,d. Therefore c'iy) G a{yF2) for all y E F. Then a' induces a on -F/F2, and since 
U is fully invariant, maps U to itself. So a' induces an endomorphism a" of G. But a" 
induces cr, an automorphism of F/F2 = {F /U) / {F2/U) = G/G2- By Proposition 13. 4[ a" is 
an automorphism of G. Thus a lifts to an automorphism a" of G. □ 



3.3 Enumerating Groups in a Variety 

In this section, we develop a general strategy for enumerating certain sets of p-groups and 
apply this strategy to prove Theorem 12.21 The key idea to use the theory of varieties of 
groups. Our exposition follows Neumann [751 Sections 1.2-1.4]. 

Let be the free group freely generated by X = {xi, X2, . . . }. A word w is an element 
of Xoo- A word w is a law for a group G if a{w) = 1 for every a G Hom(Xoo, G). Each subset 
W of Xoo defines a variety of groups V consisting of all groups for which each word in W is 
a law. For example, the class of abelian groups forms the variety V defined by the singleton 
set W = {xia;2a;f More relevant to our investigations is the variety of p-groups of 

lower p-length at most n. This variety is defined by (for example) the set W = {Xoo)n+i- 

For each positive integer d, the variety V contains a relatively free group of rank d. This 
is the group F/U, where F is the free group of rank d and U is the (fully invariant) subgroup 
of F generated by the values a{w) for all a G Hom(Xoo, F). In the variety of abehan groups, 
the relatively free group of rank d is (isomorphic to) Z'*. In the variety of p-groups of lower 
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p-length at most n, the relatively free group of rank d is F/Fn+i- By Proposition I3.5[ the 
smallest cardinality of a generating set of F/U is d{F/U) = d. The relatively free group of 
rank d has a generating set of cardinality d, called a set of free generators, such that every 
mapping of this generating set into the group can be extended to an endomorphism. 

When the relatively free group G of rank dm. a, variety ^ is a finite non-trivial p-group, 
we can describe K{G) and A{G) precisely. In particular, by taking V to be the variety of p- 
groups of lower p-length at most n and G = F/Fn+i, we can find K{F/Fn+i) and A{F/Fn+i). 
Furthermore, questions about groups in V and their automorphism groups can be translated 
into questions about certain orbits of subgroups of G. This is the content of Theorems 13.71 
and 13.81 from which Theorem 12.21 follows by specializing to the variety of p-groups of lower 
p-length at most n. 

Theorem 3.7. Suppose that G is the relatively free group of rank d in a variety of groups 
V, and suppose that G is a finite p-group. Let A be the set of normal subgroups of G lying 
in G2, and let 2t be the KniiG)- orbits in A. Then 

TT : 2t ^ {H eV : d{H) = d} 
L ^ G/L, 

where L & A, is a well-defined bijection. 

Fix L E A and let H = G/L. Write A^Aut(G)(-^) for the normalizer of L in Aut(G') and 
B{L) for the normal subgroup of NAut{G){L) that acts trivially on H. Then, 

1 ^ B{L) ^ iVAut(G)(^) ^ Aut(/J) ^ 1 

is exact. The subgroup B{L) is isomorphic to the direct product of d copies of L. If L = G2, 
then Aut(G) = A^Autcol^s), K{G) = B{G2), and A{G) = Aut{G/G2) = GL(rf,Fp). 

Proof. By Proposition 13.61 any automorphism of F/F2 = G/G2 lifts to an automorphism of 
G. Thus A{G) is isomorphic to the full automorphism group of G/G2, namely GL{d,¥p). 

Up to isomorphism, G/L depends only on the orbit of L, so vr is well-defined on 21. 
To prove that vr is surjective, consider any group H E V with d{H) = d. Evidently H is 
isomorphic to G/L for some normal subgroup L of G. If L were not contained in G2, then 
we could choose hi E L\G2 and extend {hi} to a generating set {hi, /i2, . . . , ha} of G. But 
then H = G/L would be generated by the images of /i2, • • • , ha, contradicting d{H) = d. So 
L is contained in G2, and H is in the image of the map vr. 

To prove that vr is injective, suppose that L and M are in A and G/L = G/M. Let 
(3 : G/L G/M be an isomorphism. By [751 Theorem 44.21], there is an endomorphism 
7 : G — > G so that the diagram in Figure 1 commutes. Then 7 induces f5, and (3 induces 
an automorphism on G/G2, since [G / L) / {G2/ L) and {G/M)/{G2/M) are canonically iso- 
morphic to G/G2- It follows from Proposition 13.41 that 7 is an automorphism of G. From 
Figure 1, it is also clear that 7(i^) < M. Thus "^{L) = M, and L and M are in the same 
Aut(G)-orbit. 
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Figure 1 

If we take L = M, we find that any automorphism of H = G/L is induced by an 
automorphism of G, so that Aut(iJ) = NAut{G){L) / B (L) . 

Let gi, g2, . ■ . , gd a set of free generators for G, and let £i, £2, • • • , be any elements 
of L. Since G is relatively free, the map a that sends gi to giii for all i = 1, . . . ,d extends 
to an endomorphism of G. Then a acts trivially on G/L, and hence acts trivially on G/G2, 
so a is an automorphism by Proposition I3.4[ Conversely, any automorphism of G that acts 
trivially on G/L must act on each g^ as multiplication by an element of L. Thus B{L) is 
isomorphic to the direct product of d copies of L. The specialized statements for L = G2 
follow directly from the definition of K{G) and the fact that G/G2 = {GpY- □ 

Theorem 3.8. Suppose that G is the relatively free group of rank d in a variety of groups V , 
and suppose that G is a finite p-group with lower p-length n> 2. Let C be the set of normal 
subgroups of G lying in Gn, and let £ be the Aut{G)-orbits in C. Then the map tt defined in 
Theorem \3.8\ restricts to a well-defined bijection 

tt\^:€ ^ {H eV : d{H) = d andH/Hn = G/Gn} 
L ^ G/L, 

where L E C. 

The subgroup K{G) o/Aut(G) acts trivially on C, so A{G) = Ant{G)/K{G) = GL{d,¥p) 
acts on C, and the Aut(G')— and GL {d,¥p) — orbits on C are identical. 

Fix L E C and let H = G/L. Write iVAut(G)(-^) f'^'i" the normalizer of L in Aut(G') and 
B{L) for the normal subgroup of Np^^^G)iL) that acts trivially on H. There is a natural 
isomorphism K{G)/B{L) = K{H), and this extends to an exact sequence 

1 ^ K{G)/B{L) ^ Aut(if) ^ Ngw^){L) ^ 1. 

In particular, A{H) = A^GL(d,Fp)(-^^)- 

Proof. Let L E A and write H = G/L. Then H/Hn = G/GnL is isomorphic to G/Gn if 
and only if L < G„. This shows that 7r|ir is a well-defined bijection. As noted in Section [3^ 
K{G) acts trivially on Gn = Gn/Gn+u and by Theorem [321 MG) = GL(d,Fp). Thus 
A{G) = GL{d, ¥p) acts on C, and the Aut(G)— orbits and GL{d, Fp)— orbits on C are identical. 
Now suppose L E C. Then 

1 ^ K{G) ^ Na^,^g){L) ^ NGW,)iL) ^ 1 

is exact. By the exact sequence in Theorem 13. 7[ every automorphism in K{H) is induced 
by an automorphism in A'Aut{G)(-^^)- Since G/G2 = H/H2, the automorphism in A^Aut{G)(-^) 
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must act trivally on G/G2-, that is, it must be in K{G). Therefore K{G) surjects onto K{H). 
The kernel of this map is B{L), so K{G)/B{L) = K{H). The above exact sequence induces 
the exact sequence 

1 ^ K{G)/B{L) ^ N^^,^G){L)/B{L) ^ NGUd,^^){L) ^ 1. 

By the second exact sequence in Theorem 13.71 it follows that 

1 ^ K{G)/B{L) -> Aut(i7) ^ iVGLKF,)(i^) ^ 1 

is exact. □ 

We can specialize Theorems 13.71 and 13.81 to prove Theorem \2.2\ restated here for conve- 
nience. 

Theorem 12.21 Fix a prime p and integers d,n > 2. Let F be the free group of rank d and 
define the following sets: 

{normal subgroups of F/Fn+i lying in -^2/^^+1} 
{normal subgroups of F/Fn+i lying in F^jFn+x 

and not containing 
{normal subgroups of F / Fn+i lying in F„/F„+i} 
{normal subgroups of F/Fn+i contained in the 
regular GL{d,¥p)- orbits in C^.n} 



{Aut {F / Fn+i)- orbits in Ad,n} 
{kni{F / Fn+i)- orbits in Bd,n} 

{AvLt{F/Fn+i)- orbits in Cd,„} = {GL{d,¥p)- orbits in Cd^n} 
{regular GL {d,¥p) -orbits in Cd,n}- 

Then there is a well-defined map TTd,n '■ ^d,n {finite p- groups} given by L/Fn+i ^ F/L, 
where G Ad^n- Furthermore TCd^n induces bisections 

^d,n ^ {p-groups H of lower p- length at most n with d{H) = d} 
^d,n ^ {p-groups H of lower p- length n with d{H) = d} 
2?d,n ^ {p-groups H in nd,n{^d,n) with A{H) = 1}. 

Proof. Take V to be the variety of p-groups of lower p-length at most n. Applying Theo- 
rems [XT] and ESI with G = F/Fn+l, A = Ad,n, 21 = ^d,n, C = Cd,n, ^ = and TT = 7ld,n 

proves all but the statements about Dd,n- As for those, a subgroup L/Fn+i G Cd^n is in a 
regular GL(c?, Fp)-orbit if and only if NQ^d,¥p){L/ Fn+i) = 1. By Theorem 13. 8[ this occurs 
precisely when A{F/L) = 1. Thus the bijection for Dd,n is proved. □ 



= 

^d,n 

= 
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Chapter 4 

The Lower p-Series of a Free Group 



Let F be the free group of rank d with free generating set yi,y2, ■ ■ ■ ,yd- As explained in 
Chapter [3], there is an intimate connection between the lower p-series of finite p-groups and 
the lower p-series of F. As a result, Chapters [5] and [6] rely on a detailed understanding 
of the quotients Fn/Fn^i. In this chapter, we analyze the FpGL((i, Fp)-module structure 
of Fn/Fn+i and power and commutator maps from to F„+i/F„+2. Our main tool 

will be the connection between the lower p-series of F and the free Lie algebra described 
in Theorem I4.8[ The results of Theorem 14.81 appear several times in the literature with 
varying degrees of correctness and detail. The best references are Bryant and Kovacs [lOj 
and Huppert and Blackburn [l9l Chapter VIII] . The proof given below seems to be the first 
time that a complete proof has been written down. 

4.1 The Free Lie Algebra 

We will say just enough about free Lie algebras for our purposes. More information about 
free Lie algebras can be found in Garsia [29] and Reutenauer ^82j. Our discussion follows 
Bryant and Kovacs [10]. 

Let K be any field and let A = {xi, . . . ,Xd} be an alphabet on d letters. Write A* for 
the set of all A- words and A^ for the set of all A- words of length n. Let denote 
the free associative i^"-algebra on the generators Xi,X2, ■ ■ ■ ,Xd', equivalently, is the 

non-commutative algebra of polynomials 



with coefficients € K. The algebra /('[A*] is graded by degree; let i^r[74"] denote the 
homogeneous component of degree n. Also, if[y4*] is a Lie algebra under the Lie bracket 
[/) 9] = f9 ~ 9f- Let K[A*] denote the Lie subalgebra of generated hj xi, . . . ,Xd and 

the Lie bracket. Then i^[A*] is the free Lie algebra over K on xi, . . . ,Xd- It is also graded 
by degree; let i^[A"] be the homogeneous component of JC[A*] of degree n. 
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The group GL{d, K) acts as the group of i^-automorphisms on the if- vector space if[A^]. 
This action extends to the i^"- vector spaces and -ft" [A"], and so these may be regarded 

as KG\j{d^ if)-modules. 

It will be convenient to specify a basis of if [A"]. Lexicographically order the set A*, 
where xi < X2 < ■ ■ ■ < Xd- A word w is a Lyndon word if it is smaller than all of its proper 
non-trivial tails. Let L be the set of Lyndon words, and let L„ be the set of Lyndon words 
of length n. Inductively define the right standard bracketing h[w] oi w E Lhy 

h[w] = w 

if w E A and otherwise by 

b[w] = [b [wi] , b [W2]] , 
where w = W1W2 and W2 is the longest proper tail of w that is a Lyndon word. 

Theorem 4.1 (Reutenauer [82| Proof of Theorem 5.1]). If w E L, then 

b[w] = w + y^jyv 

for some fy G K . The set {b[w\ : w G Ln} forms a basis for if [A"]. 

4.2 The Free Lie Algebra and Fn/Fn + i 

The connections between the free Lie algebra and i^„/ i^„+i given in Theorems 14.81 and 14.91 
rely on several theorems and lemmas in the literature. We begin with the connection be- 
tween Fn/Fn+i and the lower central series of F. For each positive integer n, let Sn = 
7„(F)/7„(F)P7„+i(F). If Sn G 7n(-^), let denote the image of s„ in 5'^. 

Theorem 4.2 (Huppert and Blackburn [49l Chapter VIII, Theorem 1.9(b) and (c)]). For 

each positive integer n, there is a bijection 

an : Si X S2 X ■ ■ ■ X Sn Fn/Fn+l 

(— — — \ p"~^ T-^ 

{Si, S2, ■ ■ ■ , Sn) ^ Si S2 ■■■Sn-Tn+l- 

When p is odd or p = 2 and n = 1, this map is an isomorphism. When p = 2 and n > 2, 
this map restricts to an isomorphism 

S2X---X Sn^{Fnn 72 (F) )Fn+l/i^«+l • 

The next theorem connects the lower central series of F and the free Lie algebra. 

Theorem 4.3 (Magnus, see Reutenauer [821 Corollary 6.16]). For each positive integer n, 
there is a canonical isomorphism 

«„:7„(F)/7„+i(F)^Z[A"] 
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satisfying 

ai : ya2{F) y-^ Xi 

for i = 1, . . . ,d and 

an : [zj,Zk]jn+i{F) t-^ [aj{zjjj+i{F)),ak{zkjk+i{F))] 
for all Zj G 'yj{F) and Zk G 7fc(-F) such that j + k = n. 

Corollary 4.4. For each positive integer n, there is a canonical isomorphism 

induced by a„. Furthermore, 

/? = A X /52 X ■ ■ ■ X /5„ : 5i X ^2 X ■ ■ ■ X 5„ ^ ¥p[A'] © ¥p[A^] © ■ • • © Fp[A"] 
is an isomorphism. 

We also need some results from commutator calculus. 

Theorem 4.5 (P. Hall, adapted from Leedham-Green and McKay [591 Theorem 1.1.30]). 

Let a and b be elements of a group G. Then for all positive integers m, 



{aby"' =aP"'bP"'[b,af^)lllld 



1,3 

i=3 j 



for some elements Cij G 'Ji{G) and some integers Cij. Each integer Cij is a Tj-linear combi- 
nation of (p") , (^2") , • • • , (^r) ■ 

Corollary 4.6. Let a and b be elements of a group G. Then for all positive integers m, 

. ,.,.^r a2'"62'"K mod72(G)2'"73(G)^-^nr=2 72^(G')^'"'^ : P = 2 

^ ^ "I a^-^lf"- mod72(Gmr=i7pKG'r"" : P > 2. 



Furthermore, 

a^'"6^"'[a, 6]^™" mod 6*^+2 : p = 2 
aP""bP"' mod Gm+2 '■ p > 2. 



(abr 



Proof. Given a positive integer j, write j = kp^ with r > and k relatively prime to p. Then 
(^''j ) is divisible by p"^~^. It follows that any Z-linear combination e of (^^ ) , ) 5 • • • 5 (^i ) 
is divisible by m — s, where p'^ is the largest power of p less than or equal to i. This shows 
that each cfj^ from Theorem 14.51 is in 'ji{Gy"' \ Then Theorem 14.51 implies that 



[aby" 



a'-b'-[b,ap) modjs{Gr~'UT-2l2riGy-' : p = 2 
aP-'lf"' mod72(Grnr=i7p^(GT~^ : p>2. 
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Next, we must show that [6, a]^ 2 j = 5]2"' mod 72(6')^'" when p = 2. But 



-J 22m— 1 _'2m,— 1 



[6, a] 

-,22m— Ir- 2^m—l 



and [6, a]^ ™ e 72(G)^™, proving the claim. Finally, the congruences modulo Gm+2 follow 



directly from the previous congruences and the fact that ■jii^Gy'^ G Gm+2 by Proposi- 
tion O □ 

Corollary 4.7. Let a and b be elements of a group G. Let i be a positive integer and suppose 
a G ^i{G). Then for all positive integers m, 



[a, bf^ [a, [a, b]f^ mod Gm+i+2 ■ P = 2 
[a, bf"" mod Gm+i+2 ■ p > 2. 



Proof. Let H = (a, [a, b]). Then 72(-ff) is the normal closure of [a, [a, 6]] in by Huppert [HJ 
Chapter III, Lemma 1.11]. So 72(-ff) < 72^ + 1(G). Furthermore, 'jj{H) < 7jj+i(G) for all 
j > 2. Thus for p = 2, 

m m 

^2{Hr7siHr-'ll^2riHr-' < l2^+^{Grl^^^liGr"ll^^2r+liGr-' 

r=2 r=2 

^ Gm+i+2} 

and for p > 2, 

m m 

-f2{Hr-l[^,r{Hr-' < ^2^+liGn[^^pr^^^Gr'^ 

r=l r=l 
< Gm+i+2 ■ 



By Corollary 14. 6 [ 



= a-P'"(a[a,6])P'" 

[a, 6] 2'" [a, [a, b]f~^ mod Gm+i+2 : p = 2 
[a, 6]^" mod Gm+i+2 : p > 2. 



□ 



These preliminaries and some extra work lead to the following two theorems. 
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Theorem 4.8. Let n be a positive integer. If p is odd or p = 2 and n = 1, then there is an 
¥pGL{d,¥p)-module isomorphism 



qemb„: F„/F„+i ^ FpfA^] © ■ ■ ■ © Fp[A"] 



where (3 is the isomorphism from Corollary 4-4 ^'^^ -^i ^ for i = 1, . . . ,n. If p = 2 and 



n>2, then there is an F2 GL ( d, F2)- modn/e isomorphism 

qemb„: F„/F„+i ^ E © FaiA^] © ■ ■ ■ © FafA"] 

where Si G 7i(-F) /or i = 1, . . . ,n and E C FafA-*^] © FafA^] is an extension of FafA^] by 
F2[Ai]. 

Proof. If p is odd or p = 2 and = 1, then 

qemb„ = /? o ct-\ 

and hence qemb„ is an isomorphism by Theorem 14. 21 and Corollary 14. 4[ In all cases, induction 
on n immediately shows that the action of FpGL((i, Fp) commutes with qemb„, so that if 
qemb„ is an isomorphism, then it is an FpGL((i, Fp)-module isomorphism. 
If p = 2 and n > 2, then qemb„ is injective since each is injective. Let 

E = im(qemb„) n (FafA^] © ¥2[A^]). 

Clearly qemb„ is surjective. The map Pi is surjective, so E + F2[v4^] = F2[v4^] © F2[v4^]. The 
map (32 is surjective, so E (1 F2[v4^] = F2[A^]. It follows that E is an extension of F2[A^] by 
F2[Ai]. 

It remains to show that qemb„ is a homomorphism when p = 2 and n > 2. Let s,t G 
FjFn+i. Write 

QTi — 1 on — 2 

s = s-^ S2 ■ ■ ■ SnFn+1 and 

t = ti ^2 ■ ■ ■ tn-t'n+l 

with Si, ti G 7i(-F) for z = 1, . . . , n. We know 

qemb„(s) + qemb„(t) = S2, • • • + + ^2, • • • Jn) 

and we must show that this equals qemb„(st). 

Note that ' ^ G for all i. From Corollary 14.61 and the fact that 
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is abelian, we find 



St 



2^71— 1 2'^~2 



tnFn+1 



on—z on— 2 1 „ 



vi=l 
n 



qemb„(st) 



(siti) [ti,sij (sats) ■ ■ ■ (s„t„)F„+i 
(Siti)^" ([tl, Si]s2t2)^" ■ ■ ■ (s„t„)F„+i 

S2, . . . ,S„) + P{ti,t2, ...,tn) 
+ (/5i(li)+/3i(ti))2+/32([tl,Si]) 



S2, . . . , S„) + Pl{Sif + P{ti, t2 



= qemb„(s) + qemb„(t). 
Thus qemb^ is a homomorphism when p = 2 and n > 2, completing the proof. 
Theorem 4.9. For each positive integer n and j = 1, . . . ,d, define the following maps: 



□ 





Fn/ Fn+l - 


Fn+l/Fn+2 




sFn+1 ^- 




Fconij-^ 


Fn/ Fn+l - 


~^ Fri+l/FriJ^2 




sFn+1 t- 


[s,yj\Fn+2 


conij 


¥p[A*] - 






f ^ 





Unless p = 2 and n = 1, the diagram below on the left commutes and pow„ is an injective 
homomorphism. The diagram below on the right commutes and Fconij^^ is a homomorphism. 



Fn/ Fn 



qemb„ 



+1 



pow„ 




Fcomw 



Fn+l/ Fn+2 

Proof. Let s G F„/F„+i. Write s = "^s^ 



n—1 „n— 2 



SnFn+i with Si e 7i(F) for i = 1, . . . , n. Of 



course, s^ G F„ for i 



1, . . . ,n. Using Corollary 14.61 with G = Fn, if p > 2 or n > 2, 



mod Fr 



n+2- 



So pow„(s) 



pow„ = qemb„i^ o qemb„ is an injective homomorphism unless p = 2 and n = 1. 



p p 

Si S2 



' s^Fn+2- It is clear that qemb„(s) = qemb„_|,i(pow„(s)). Thus 
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The map coiiij is an (additive) homomorphism by the hnearity of the Lie bracket. The 
commutator identity [ab,c] = [a,c]^[b,c] and the fact that -Fn+i/-^n+2 is central in F/Fn+2 
show that 

= [sf , Vj] [sf , Vj] ■■■[sn, Vj] mod Fn+2. 
If p > 2, then Corollary 14.71 shows that 

[sf 'sf ' ■ ■ ■ Sn, Vj] = [Sl, VjY" ' [S2, VjY" ' • ■ ■ [Sn, Vj] Hiod Fn+2, 



and clearly qemb„_,_^(Fcomj(s)) = comj(qemb„(s). 

If p = 2, note that [si, [si,yj]]'^" ' ^ G for all i. Thus by Corollaries 14.61 and 14. 7[ 



2^1 — 1 2^~2 



C2 ■■■Sn,yj] = [si,yj] [si,[si,yj]] [s2,yj] ■■■[sn,yj] mod F„+2 

= [suVj?" \[su[suyj]][s2,yj]f" ■■■[sn,yj] mod F„+2 
qemb„+i(Fcomj(s)) = [/9(si,S2, . . .,Sn),Xj] + [(3i{si), [(3i{si),Xj]] 

= [f3{si,S2, . . .,Sn),Xj] + [Pi(sif,Xj] 

= comj(qemb„(s)). 

Thus in either case, Fcomj = qemb^^^ o comj o qemb„ is a homomorphism. □ 

We conclude this section with two corollaries of Theorem 14.81 First, the dimension of 
i^[A*] is given by Witt's formula: 



dim(ir[A^]) = i5^MVj)-rf'' 



where /i is the Mobius function (see Reutenauer [821 Appendix 0.4.2]). Thus Theorem 14.81 
tells us the dimension of Fn/ Fn+i- 

Corollary 4.10. Let n be a positive integer. The dimension of Fn/Fn+i is 

" 1 

i=l j\i 

We also need to know some numerical bounds on d^, but these are computed in Lem- 
mas |A]3] and |A]4l For the second corollary, let V be the natural FpGL((i, Fp)-module. Then 
¥p[A^] = V and ¥p[A^] = V AV as FpGL(rf, Fp)-modules. Therefore Theorem SS] tells us the 
following fact. 

Corollary 4.11. Let n > 2. Then Fn/Fn+i contains a ¥pGL{d,¥p)-submodule isomorphic 
to an extension ofVAV by V , where V is the natural ¥pGL{d,¥p)-module. 

This will be needed to apply Theorem 16.31 to groups of lower p-length 2. 
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4.3 The Expansion of Subgroups of F/F^ + i 

The remainder of this chapter is devoted to proving the following theorem and corollary. 
Corollary 14. 131 will be combined with Theorem 15. II to prove Corollary 15.21 which gives upper 
bounds for the number of normal subgroups of with certain properties. 

Theorem 4.12. Fix a prime p and integers d > 3 and i > 2. Suppose that U is a normal 
subgroup of F lying in F2 . Let 

Q = (f/nF,)F,+i/F,+i 

S = (f/^[f/,F]nF,+i)F,+2/F,+2. 

Viewing Q, R, and S as ¥p-vector spaces, their dimensions satisfy dim(i?) > dim(Q) and 
dim(5) > (3/2) dim(Q). 

The third isomorphism theorem lets us replace F by F/Fn, giving the following corollary. 

Corollary 4.13. Fix a prime p and integers d > 3, n > 3, and 2 < i < n. Let G = F/Fn+i. 
Suppose that U is a normal subgroup of G lying in 6*2 ■ Let 

Q = {UnGi)G,+i/Gi+i 

R = (f^2 n Gj+i)G'i+2/G'i+2 

S = {UP[U,G]nG,+^)G.,+2/G.,+2. 

Then dim(i?) > dim(Q) and dim(5) > (3/2) dim(g). 

To prove Theorem 14.121 we will build up to an analogous result for the free Lie algebra 
(Lemma 14.181) and then apply Theorem 14. 8[ Informally, the result for the free Lie algebra 
says that if we start with a finite-dimensional subspace W of Fp[y4*] and add to it the 
subspace generated by {[W, Xi] : z = 1, . . . , c?}, we get a new subspace whose dimension is 
at least (3/2) dim(py). It seems reasonable to describe this as investigating the "expansion 
of a subspace when taking commutators" , hence the title of this section. 

We need to define three more maps: 

com : {subspaces of Fp[y4*]} {subspaces of Fp[74*]} 

W ^ [W,¥p[A^]] 

comj-„ = comj|Fp[A"] 

proj„ : ¥p[A*] ^ ¥p[A^] 

the projection map onto Fp[A"] 
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Lemma 4.14. The following diagram commutes: 

comw 



proj 



Fp[A"] 



com 



If n = 1, then the kernel of com is spanned by xj. If n > 1, then comj^n is infective. 

Proof. The only statements requiring proof are those about the kernel and injectivity of 
comj „. Without loss of generality, we may assume that j = I- Suppose that w G L„. Unless 
n = 1 and w = Xi, we see that Xiw is smaller than w, and hence smaller than all of its 
proper non-trivial tails. So xiw G Ln+i- Furthermore, w is the longest tail of xiw that is a 
Lyndon word, so = — Thus the image of b[w] under comi^„ is the negative 

of a basis element in Ln+i, unique for each w. It follows that the kernel of comi i is spanned 
by Xi and comi^„ is injective for n > 1. □ 

Lemma 4.15. Fix d > 3 and n > 2. Suppose that W is a subspace o/Fp[A"]. Then 
dim(com(Vr)) > (3/2) dim(Vr) . 

Proof. Let Fp[A*]jj denote the free Lie algebra on two generators Xi and Xj; there is a natural 
embedding of Fp[A*]jj into Fp[A*]. Let Fp[A"']jj be the homogeneous component of degree n 



First, we claim that if / and g are distinct elements of Fp[A"] and [/, Xi] = [g, Xj], then in 
fact f,g E Fp[A"]jj. We may assume that i,j > 1. Suppose that / ^ Fp[A"']jj. Then writing 



there must be some word w E Ln where fw^O and w contains a letter other than Xi and Xj. 
We may assume that w contains the letter xi, and since w G L„, it must be that w starts 
with xi. In that case, by Theorem 14.11 there is a word beginning with xi that appears in / 
with non-zero coefficient. Thus there is a word beginning with xi and ending with Xi that 
appears in [/, Xi] with non-zero coefficient. No such word can appear in [g, Xj], contradicting 
the fact that [f,Xi] = [g,Xj]. Hence / G Fp[A"']jj and similarly g G Fp[A"]jj. 

Note that Fp[A"']jj fl Fp[A"']fci = if {i,j} 7^ {k, 1} (the letters Xi and Xj appear in every 
element of Fp[A"]jj since n > 1). Choose i and j so that dim(W^ fl Fp[A"']jj) is as small as 
possible; in particular this intersection has dimension at most (1/2) dim(Vr). Let X be a 
complement to W f) ¥p[A%j in W. 

We can define a more restrictive commutator map on subspaces by com^j : • 1-^ [•, Fp[A-'^]jj]. 
Obviously comij{W) C com{W). Using Lemma [4.141 and the above claim. 



in ¥p[A%. 



dim{comi j(Wj) 



= dim{comij{W n Fp[A"]ij)) + dim(comij(X)) 

> dim{W n ¥p[A%) + 2 dim(X) 

> (3/2) dim VT. 



□ 
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Lemma 4.16. Fix d > 2. Suppose that W is a subspace of Fp[A^]. Then dim{W + 
com(W^)) > (3/2)dim(Vr). 

Proof. Recalling Lemma [4.14[ this is clear if dim(Vr) = 1, and otherwise 

dim(comi^i(l^)) > dim(iy) - 1, 
implying the result since W and com{W) are disjoint. □ 

Lemma 4.17. Let p = 2. Suppose that W is a subspace of E, where E is defined in 
Theorem\J^ Then dim{W + com(l^)) > (3/2) dim(iy). 

Proof Let X = W n F2[A^] and let F be a complement to X in W. Note that dim(F) = 
dim(proj]^(y)). By Lemma [4. 16^ 

dim(proji(F) + com(proji(F))) > (3/2) dim(proji(F)). 

By the commutative diagram in Lemma |4]T4l it follows that Y + com{Y) contains a subspace 
of dimension at least (3/2) dim(y) that has trivial intersection with F2[A^]. By Lemma H]T5l 
com(X) < F2[A^] contains a subspace of dimension at least (3/2) dim(X). Then 



dim(iy + com(iy)) > (3/2) dim(X) + (3/2) dim(r) = (3/2) dim{W). 



□ 



Lemma 4.18. Fix d > 3. Let 



Fp[Ai] © ■ ■ ■ © Fp[A"] : p IS odd orn = l 
E © FsiA^j © ■ ■ ■ © F2[A"] : p = 2 and n > 2. 

Suppose that W is a subspace of ¥p[A*] contained in Un- Then dim(W^ + com.{W)) > 
(3/2)dim(iy). 

Proof. The proof will be by induction on n. When p is odd and n = 1, Lemma [4.161 gives 
the result. When p = 2 and n = 2, Lemma [4.171 gives the result. So assume that p is odd 
and n > 1 or that p = 2 and n > 2. Assume the result holds for n — 1. Let X = W (1 Un-i- 
By the inductive hypothesis, 

dim(X + com(X)) > (3/2) dim(X). 

Furthermore, X + com(X) < Let F be a complement to X in W. By the commutative 
diagram in Lemma [4.141 com(proj„(y)) = proj„_,_]^(com(y)). By the definition of X and Y, 
dim(proj„(y)) = dim(y). By Lemma [4.15[ 

dim(proj„+i(com(r))) > (3/2) dim(proj„(F)). 

Thus com(y) contains a subspace of dimension at least (3/2) dim(proj„(y)) that has trivial 
intersection with f/„. Therefore 

dim{W + com{W)) > (3/2) dim(X) + (3/2) dim(r) = (3/2) dim{W). 

□ 
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Proof of Theorem\4.1S\ Replacing f/ by (f/ fl does not change Q, R, or S, so we 



may assume that Fn+i < U < Fn- Recall that by Corollary I4.9[ pow„ is injective. Since 
pow„((5) = R, it follows that dim(_R) > dim{Q). 
Also by Corollary I4.9[ 

S = qemb~j:;^(qemb„(?7) + (com o qemb„)(f/)). 

Since qemb„ is injective, and 

dim(qemb„(f/) + (com o qemb„)(f/)) > (3/2) dim(qemb„(f/)) 

by Lemma im it follows that dim(5') > (3/2) dim(Q). □ 

It is reasonable to wonder if the factor of 3/2 in Lemma [4. 181 (and hence in Theorem 14. 121) 
is the best possible. It almost certainly is not; intuitively a factor of about d seems right, 
but this appears to be much harder to prove and is an interesting question in its own right. 
Fortunately, 3/2 suffices for our purposes. 
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Chapter 5 

Counting Normal Subgroups of Finite 
p-Groups 

The goal of this chapter is to prove Theorem I2.4[ Recall from Chapter [2] that if 

{normal subgroups of F/Fn+i lying in F2/F„+i}, 
{Aut(F/F„+i)-orbits in Ad,n}, 

{normal subgroups of F/Fn+i lying in and 
{Aut(F/F„+i)-orbits in Cd,n} = {GL(rf, Fp)-orbits in Cd,n}, 

then Theorem 12.41 essentially shows that the number of GL((i, Fp)-orbits in (td,n is large 
relative to the number of orbits in This is nominally a result about counting orbits, 

but we can actually show that the number of subgroups in Cd^n is so large that even if every 
orbit in (Ld,n was regular (that is, if C^.n was as small as possible) and if every orbit in 
2td,ri, \ ^d.n was trivial (that is, if 2ld,„ \ ftd,n was as big as possible). Theorem 12.41 would still 
hold. 

5.1 The Number of Normal Subgroups of a Finite p- 
Group 

Given a finite p-group G of lower p-length n and non-negative integers ui, . . . ,Un, we can 
form a set S{G, ui, . . . , Un) of normal subgroups of G by 

S{G,Ui, . . . ,Un) = {U < G : dim((f/ n G'j)G'j+i/G'j+i) = -Uj for z = 1, . . . , (i}. 

Our goal in Theorem 15.11 is to give an upper bound on the size of S{G, Ui, . . . , Un). Spe- 
cializing this bound to F/Fn+i and summing over certain choices of Mi, . . . , u„ will give us 
an upper bound on the size of Ad,n \ Cd,n, allowing us to prove Theorem 12.41 The bound in 
Theorem 15.11 depends on certain parameters of the group which are difficult to work out in 
general, but were calculated for F/Fn+i in Corollary 14. 131 



A-d^n 
C-d,n 
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An alternate way to view S{G, Ui, . . . , Un) is to note that 

{U n G'i)G',+i/G',+i ^ (f/ n Gi)l{u n G.+i) 

by the Second Group Isomorphism Theorem. Then 

f/nG'i>f/nG'2>--->f/n Gn+i 

is a central series of U with elementary abelian quotients of order p"^,^"^, . . . (in that 
order). The set S{G,ui, . . . ,Un) consists of all normal subgroups U of G whose associated 
series has specified quotients. 

Furthermore, each subgroup U E S{G,ui, . . . determines the following data, which 
we will denote collectively by Q{U): 

1. A subgroup J of G„, given by f/ fl G„; 

2. A normal subgroup K of H, given by UGn/Gn] and 

3. A complement to Gn/ J in UGn/J, given by U/J. 

In fact, the data Q{U) uniquely determines U G S{G, Ui, . . . , Un)- Given 0(f/), the subgroup 
UGn is uniquely determined as the inverse image of K in G. Then the complement to G^j J 
in UGn/J given by Q{U) is V/J for a unique normal subgroup V oi G. Thus U = V and 
Q{U) uniquely determines U . 

There does not seem to be any prior literature on the number of normal subgroups of an 
arbitrary finite p-group. Birkhoff |8] gave an exact formula for the number of subgroups of a 
finite abelian p-group, but Theorem 15. II is apparently unrelated to that result. It is unclear 
how good the upper bound in Theorem 15. II is in general; it is simply sufficient for our needs. 

Theorem 5.1. Suppose G is a finite p-group with lower p-length n. Let Qi = dim (Gj/Gj+i) 
for all i = 1, . . . ,n. Suppose ui, U2, ■ ■ ■ ,Un are integers satisfying < Ui < gi for all i = 
1, . . . ,n, and define S{G, Ui, . . . , Un) as above. Suppose that for each U G S{G, Ui, . . . , Un) 
and 1 < i < n, 

dim((f/2nG,)G,+i/G,+i) >t;, 

and 

dimi{UP[U,G] n > w,. 

Then 

\S{G,Ui, . . . ,M„)| < 

Proof. The proof will be by induction on n. If n = 1, then G is elementary abelian of 
dimension gi. In this case, \S{G, ui)\ counts the number of subgroups of G of dimension ui, 
and this number is T^^l . 



91 

Ml 



n 

-I P i=2 



9i - 

Ui - 



p 



{gi-Ui){uiA \-Ui^i-vi Vi-i) 



J p 
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For our inductive hypothesis, suppose that n > 2 and that the result holds in H = G/Gn, 
a p-group of lower p-length n — 1. For l<'i<n— 1, itis clear that Hi = Gi/Gn and 
gi = dim{Hi/Hi+i). Thus 



r H n—1 



\S{H,ui, . . . < 



91 

Ul 



n 

P i=2 



gi - Wi 

Ui - Wi 



p 



hMi-i-fi- 



-fi-i) 



Since there is a bijective correspondence between subgroups U G S{G,Ui, . . . ,Un) and data 
6(f/), we can give an upper bound for \S{G, ui, . . . , Un)\ by giving an upper bound for the 
number of possibilities for Q{U). First, J = U (1 Gn is a subspace of Gn of dimension 
Furthermore, J must contain U^[U,G] fl Gn, which by assumption has dimension at least 
Wn- Thus the number of choices for J is at most p"""^"] . 

Next, we can show that K = UGn/Gn G S{H,ui, . . . ,Un-i)- Namely, for each i = 
l,...,n-l. 



{U Gn/ Gn n Gi/ Gn){Gij^i/Gn) / (Gj+i/ Gn) 

{U Gn n Gi)GiJ^i/ Gj+i 
{U n Gi)G,+i/G i+l, 



(5.1) 



and so dim (K fl Hi)Hi^i/Hi^i = Ui. It follows that K G S{H,ui, . . . So there are 

at most \S{H, ui, . . . , Un-i)\ choices for K. 

Finally, we must bound the number of complements U / J to Gn/ J in UGn/ J- Note that 
Gn/ J is central in UGn/ J since Gn is central in G. It follows from (say) Lubotzky and 
Segal [Ml Lemma 1.3.1] that the number of complements to Gn/ J in UGn/ J is 



\Rom{{UGn/ J)/{Gn/ J),Gn/ J)\ 



\Rom{UGn/Gn,Gn/J)\ 

|Hom(ir,G„/J)| 

\Rom{K/K2,Gn/J)\. 



The dimension of G„/ J is hn — u„. Also, 
6.im{K/K2) = dim{K) - dim(K2) 

n-1 

= Yl ^ H,)H,+,/H,+,) - dim((ir2 n H,)H,+,/H, 



n-1 



i=l 



Note that K2 = U2Gn/Gn, and a similar calculation to Equation 15. II shows that 

{K2 n Hi)H,+^/H,+^ = {U2 n Gi)G,+i/Gi+i, 
which by hypothesis has dimension at least fj. Thus 

dim(K/i^2) < Ml H h Un-l - ivi-\ h Vn-l) 
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and 

|H0m(ir/i^2,G'„/J)| < p(9n-«n)K+-+«„-l-«l--«n-l)_ 

Using the inductive hypothesis gives 



\S{G,Ui,...,Un)\ < \S{H,Ui,...,U„,-l) 



< 



9i 

Ui 



n 

P i=2 



gi - Wi 

Ui - Wi 



■p 



{gn-U„){uiA \-U„-l-Vl V„-l) 



p 



igi-Ui)iuiA \-Ui-i-vi Vi-i) 



□ 



Corollary 5.2. Fix d > 3 and n > 3. Let F be the free group of rank d and let di 
dim(Fj/Fj+i) for each i > 1. Then 



\S{F/F,+,, 0,U2,..., n„) I < D{pr-' 



/2){di-Ui) 



1=2 



where 



OO 

Dip) = Ur- 



— pi 



Proof. Letting G = F/F^+i in Theorem 15.11 it is clear that Qi = di. Since Ui = 0, each 
U G S{F/Fn+i, 0,U2, . . . , Un) is contained in G2, and so contains U2 and U'^[U, G]. Thus 
we can choose f 1 = f2 = 1 = W2 = 0. By Corollary I4.13[ for 3 < z < n, we can choose 
Vi = Ui-i and Wi = \{3/2)ui^i\. Finally, Lemma [A,.2I Equation lA. II gives an upper bound for 
the Gaussian coefficient . The formula from Theorem 15.11 becomes 



i=2 



< 



< 



D{pr'^\[p^-^~ 



■Wi)(di-Ui)+{di~Ui)ui 



■{3/2)ui^i){di~Ui)+(di-Ui)ui 



i=2 



/2){di-Ui) 



i=2 



□ 



5.2 A Proof of Theorem 12.4 



We can now prove Theorem 12.41 and Corollary 12. 5[ restated here for convenience. 
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Theorem 12.41 Fix a prime p and integers d and n so that either n > 3 and d > 6 or 
n > 10 and d > 5. Let F be the free group of rank d and let di he the dimension of Fi/Fi^i 
for i = 1, . . . ,n. Then 



p 



Proof. Note that a normal subgroup U of lies in F2/Fn+i if and only if f/ G 

S'(F/F„+i, 0, M2, . . . ,Mn) for some integers U2, ■ ■ ■ ,Un- Also, U lies in Fn/Fn+i if and only 
if M„ = ■ ■ ■ = Un-i = 0. If U does not lie in Fn/Fn+i, then 1 < u„_i < Wn < Un, so u„ > 2. 
Thus, using Corollary 15.21 we find 

An = Cd,„U U S{F/F^+ 

U2,...,U„ 

and 

n 

where the sums are over 

< Ui < dj for i = 2, ... ,n — 2, 

1 < Un-i < dn-i, and 

2 < u„ < dn- 

The above sum is precisely the quantity D{p)"-~^Ai{0) from the statement of Lemma [A. 51 
Hence 

Since \Cd,n\ is the number of subspaces of a (i„-dimensional Fp- vector space, denoted Qd„{p) 
in Appendix El it follows from Lemma [X2] and the fact that 2 — 9p^^"'^"^/^/2 > 1 that 

< 1 + (:7(pl5/16)^(p)n-2^^p^)n-2pd„_i-d„/4-ll/16_ 

Now 2td,„ \ (Trf^n are the Aut(F/F„+i)-orbits on Ad,n \ Cd,n, so 

Also \Cd^n\ < \^d,n\ ' |GL((i, Fp)|, since Cd^n falls into orbits, each of size at most 

\GL{d,¥p)\. Then' 



^ \^d,n\ 


- 1 


1 ^d,n 1 




\^d,n 1 




1 ^d,n 1 









Cd,n 1 









< |GL(rf,Fp; 

< C{p^^^^^)C{p)^~'^ jj^p-^n-2pd^-i-d„/4+d'^-ll/W 
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Therefore 



121, 



P 



□ 



Corollary 5.3. If n>2, then 
Ifd>5, then 

T \^d,n\ -, 

If d and n satisfy one of the conditions in Ii2. then 

lim = 1 

Proof. When n = 2, the sets ^d,n and (td,n are the same, so trivially 



I ^d,n 



1 • I ^a,n I 1 . I ^d,n 

lim = lim = 1. 

For all other cases, we will use Theorem I2.4[ We have the inequality 

rf„_i -rf„/4 + rf^ - 11/16 = ~ (^dn - 4:dn-i - 4:d^ + ^ 

4:\n 7{n-l) 4 J ^ ' 

When n > 3 and d ^ oo, the quantity (15.21) has limit — oo. Combined with Theorem 12. 4[ 
this shows that 

d^oo \^d,n\ 

When d> 5 and n — ^ oo, the quantity (15.21) is asymptotically —d'^/in, which shows that 

1 . ^d,n -, 

Finally, by Lemma IA.4I Equation IA.51 

dn-i - rf„/4 + d^ - 11/16 < 

for all values of d and n satisfying one of the conditions in (12.11) (except the condition n = 2, 
which we have already dealt with). This, combined with Theorem 12 . 41 and the fact that C{p) 
and D(p) go to 1 as p — i> cxD, imphes that 

□ 
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Chapter 6 

Counting Submodules 



In this chapter we shall prove Theorem l2.6[ This depends on estimating |Cd,n|, the number of 
GL((i, Fp) -orbits on subspaces of -F„/F„4.i, via the Cauchy-Frobenius Lemma. To do this, we 
obtain in Theorem 16.21 an upper bound for the number of submodules of an ¥p (5f)-module, 
where g G GL{d,¥p). Theorem 16.31 strengthens this bound in a special case to deal with 
F2/F3. Both theorems draw heavily on the theory of Hall polynomials, which count the 
number of submodules of fixed type and cotype of a finite module over a discrete valuation 
ring. 



6.1 The Number of Submodules of a Module 

Suppose M is an FpGL((i, Fp)-module. Let g G GL{d,¥p). We want to count the number of 
subspaces of M (viewed as an Fp-vector space) fixed by g, which is the number of submodules 
of M as a Fp ((7)-module. We note that when M is the natural FpGL((i, Fp)-module, Eick 
and O'Brien [27| give an explicit formula for this number. The following preliminaries are 
based on Macdonald [BSl Chapter IV, Section 2]. 

Any Fp {g)-modu\e M can be viewed as an Fp[t]-module, where t.v = gv for all v G M. 
Furthermore, the number of Fp ((yf)-submodules of M equals the number of Fp[t]-submodules 
of M. Let $ be the set of all polynomials in ¥p[t] which are irreducible over Fp, and let P be 
the set of all partitions of non-negative integers. Let U be the set of all functions fi : ^ ^ P. 
Since Fp[t] is a principal ideal domain, M has a unique decomposition of the form 



¥p[t] 



for some fi E U. Here, fii{f) is the i-th part of Let 

^^^/ - W (f)Mf)- 

For each / G let Fp[t]j denote the localization of ¥p[t] at the prime ideal (/). Then 
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Fp[t]y is a discrete valuation ring with residue field of order q = p'^'^s^f\ and Mf is a finite 
Fp[t] /-module. We call /x(/) the type of Mf. 

Any submodule iV of M can be written = (Bfe<i>Nf with Nf C Mf for each / G 
That is, every submodule of M is the direct sum of submodules of the summands Mf. 
By Macdonald |66l Chapter II, Lemma 3.1] the type A of any Fp[t]-submodule or quotient 
module of Mf satisfies A C 

Both Theorems 16.21 and 16.31 depend on Theorem 16. where we calculate the number 
of submodules of fixed type in a module of fixed type over a discrete valuation ring. This 
generalizes Birkhoff 's formula for the number of subgroups of a finite abelian p-group (see [8J); 
to recover Birkhoff 's result, let a be the ring of p-adic integers. The reliance of Theorem 16.11 
(and its proof) on the theory of Hall polynomials is hidden in the citation of results from 
Macdonald |66], Chapter II]. While we will not pursue this connection, it should be noted 
that the quantity S{a', q) appearing in Theorem 16. II is equal to ^^gp g^uil)^ where g^y{q) 
is the Hall polynomial corresponding to A, /x, and z/, and so Theorem 16. II can also be phrased 
result about a sum of Hall polynomials. 

Theorem 6.1. Let a he a discrete valuation ring with maximal ideal p and let 6 = a/p he 
the residue field of order q. Let a = (ai, 0^2, . . . , ctr) and (3 = (/?!, P2, ■ ■ ■ , Ps) he partitions 
with /3 C a and let M he a finite a-module of type a'. Then the numher of suhmodules of M 
of type 13' is 

s 

^(a',/5',g) = n 

i=l 

where (3s+i is taken to he 0. 

Proof. The proof is by induction on If Pi = 0, then S{a', P', q) = I and the result holds. 
Suppose Pi > 0, and let the smallest part of P' be t, so that either Pi = ■ ■ ■ = Pt > Pt+i and 
t < s, or Pi = ■ ■ ■ = Ps and t = s. Write 

P={Pl-l,P2-l,...,Pt-l,Pt+l,...,Ps). 

Let be any submodule of M of type P , and let x be any element of M with p*x = 0, 
p^~^x 7^ 0, and ax fl A^ = 0. Then {N,x) has type P'. There are S{a',P , q) choices for A^, 
and for each A^ it follows from Chapter II, Equation 1.8] that the number of choices for 
X is just 

g"i+-+"*(l (6.1) 

On the other hand, fix a submodule L of M of type P'; we can count the number of choices 
of A^ and x so that L = {N,x). Here A^ is a submodule of L of type P whose quotient has 
type (t), and by |66l Chapter II, Equation 4.13], the number of choices for A^ is 

1 - g-1 ^ 
1-g-i ^ 



ai - Pi+i 

Pi ~ Pi+1 



H 1 
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Given A^, it follows from [661 Chapter II, Equation 1.8] that there are 



choices for x. Thus any submodule L of M of type f3' arises as {N,x) in 

^/3i + -+/3t+t(ft-l)(-]^ _ g/3t+i-/3t^ 

ways. The total number of submodules L of M of type (3' is then 



S{a',f3',q) 



g/3l + -+/3t+t(A-l)(l _ gft+l-A) 



where the second inequality uses Pi = ■ ■ 



- (3t. By induction, we know that 



n 

i=l 
t-1 

n 

i=l 



/3i+i(ai-/3i) 



(ft+i-l)(Q:,-ft + l) 



A - A+i - 1 



/3t+i(at-/3t+l) 



n 

i=l 



n 

i=t+l 

ai - /3i+i 

Pi — A+1 
t-1 



q 



,/3i+i(ai-/3i) 



q 



,/3i+i(ai-/3i) 



n 



n 



n 

i=l 



O^i ~ Pi+1 
Pi — Pi+1 



,/3i+i(ai-/3i) 



g 



2{t-l)l3t-ai at-i-it-l) . 5^ 



/3t-A+i _ X 



ttj ~ Pi+1 
Pi ~ Pi+1_ 



q 



,/3i+i(ai-/3i) _ 



gOiH hat+t ]^ _ gft-ot-l ■ 



Substituting this expression into Equation 16.21 gives the result. 



(6.2) 



□ 



Using Theorem 16. H the techniques of Appendix lAl and the definitions of C{x) and D{x) 
from Equation 12. 2[ we can give an upper bound for the total number of submodules of a 
finite Fp {g)-modu\e M. Note that every subspace of M is a ¥p {g)-modu\e if and only if g 
acts as a scalar on M, that is, as multiplication by an element of Fp. 
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Theorem 6.2. Fix d > 2 and g G GL{d,¥p). Suppose that M is an ¥p (g) -module. Let 
m = dim]Fp(M) and let Sm be the number of submodules of M. Then either g acts as a 
scalar on M and S^j = Gm{p), or g does not act as a scalar and 

logp Sm < (m^ - 2m + 2)/4 + 2e, 

where e = \ogp{C{p)D{p)) . 

Proof. Write M = ©f^^Mj, where for each i, Mi = Mf- for some fi & ^ and dimpp Mj = mj. 
Case 1: k>2. 

Each submodule of M is a direct sum of submodules of the summands Mj, so Sm = 
Il'i=iSMi < QmAp)Gm-mAp)- Thcu by Lemma ISiS, 



Sm < C{pfD{pfp</^+'^"'-'^^^'/^ < C{pfD{pfp'- 



\2 (m2-2m+2)/4 

since < mi < m. 



Case 2: k = I. 

In this case, M = Mf for some / G $. Let u = deg(/) and q = p^, and let M have type 
a' as a Fp[t] /-module, where a = (ai, . . . , a^). 

Subcase 2.1: a has at least two parts. 

li j3 = (/?!, . . . , (3s) and /? C a, then by Theorem 16.11 and Lemma IA.2I Equation IA.lt the 
number of submodules of M of type (3' is 



i=l 



DiqYYlo^^^"^-^^^ 



q" 
1=1 



Thus 



Sm = '^("''^''^) 



/3'Ca' 



< D{qY J2 Ylq^'^"'-^'^ 

/3'Ca' i=l 



< 



< 



r OLi 



D{qyllT.i'' 

i=l ft=0 



r 

,2 



D{qyC{qyl[q 



1 
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where the last inequahty follows from Lemma [A. 1[ Now D{q) < D{p) and C{q) < C{p) so, 
remembering that u{ai + ■ ■ ■ + ar) = m and using Lemma [A. 6[ 

logp^M < u{al + --- + al)/A + re (6.3) 

< {{uaif + ■ ■ ■ + {ua-rf + Are) / A 

< ((m- 1)2 + 1 + 8e)/4 

< (m^ -2m + 2)/4 + 2£, 

if m > 4£ + 1. For m < 4e + 1, 

logp^M < mV4 

< (m^ -2m + 2)/4+ (m- l)/2 

< (m^ -2m + 2)/4 + 2e. 



Subcase 2.2: a has one part. 

In this case, ai = m/u. If m > 2, then by Lemma [A. 21 Equation \KA\ 



Sm - Yl 

0</3i<ai 



/5i 



< Ciq)Diq)q^ 

< C(p)2D(p)V'^^" 

< c(p)2z}(p)V("'-'"^+')/^ 

since u > 2. On the other hand, if u = 1, then f = t — c for some c E ¥p and M = 
©™'{Fp[t]/(/)} so that g acts as the scalar c on M and Sm = Qmip)- D 

The next theorem strengthens the preceding result when the module structure is known 
more precisely and will be needed to deal with groups of lower p-length 2. 

Theorem 6.3. Fix d > 2 and g G GL{d, ¥p) with g ^ 1. Suppose that V is an ¥p {g)-module 
on which g acts non-trivially and that M is an ¥p {g)-module extension ofVAV by V . Let 
V = dimp {V), let m = dimp (M) = v{v + l)/2, and let Sm be the number of submodules of 
M. Then 

\ogp Sm < (m-4)V4 + C, 



where e = log^ {C{p)D{p)) and 

C 



e + 2m-A : m < 45 
5£ + 4 : m > 45. 
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Proof. First, if f < 9, then m < 45. In this case, 

Sm < Qm{p) 

proving the result. So we may assume that f > 10. 

Write M = ©f=iMj, where for each i, Mi = Mj. for some /« € $ and dimp^ = mi] we 
may assume that mi > m2 > ■ ■ ■ > frik. Note that mi + ■ ■ ■ + ruk = m. Then V = ©^ivrM, 
where vr is the projection from M onto V. 

Fix < t < k and set = Mi © ■ ■ ■ © M^. Also let w = dimW = rrii + h m^. 

Then Sm < Gw(yP)QM-w{p) since any submodule of M is a direct sum of submodules of the 
summands Mj . By Lemma IA.2t 

Sm < C{pfD{pfp^"'^+^'''-^^"'\ 

When 4 < w < M - 4, it follows that 

Sm < C(p)2D(p)y+(*^-^)'/^ and 
logp^Af < (M- 4)74 + 25 + 4, 

proving the result. If we cannot choose t so that 4 < w < m — 4, then since m > 9 implies 
that mi ^ 3, it must be that mi > m - 3 and /c < 4. Write F = M2 © ■ ■ ■ © M^; then 
y = dimF < 3. (It is possible that Y is the zero module and that y = 0.) At this point we 
need to prove a technical claim which we will use twice. 

Claim: Suppose that V is the direct sum of Fp (5f)-modules A and B of dimensions a > 4 
and V — a over Fp, and suppose that A C Mivr. If g acts as a scalar c on A, then c = 1 and 
A ® -B is the direct sum of a copies of B. 

Proof of claim: IfV = A®B, then V AV = {A A A) ® {B A B) ® {A® B). If g acts as a 
scalar c on A, then A = ©{Fp[t]/(t — c)}" and Mi = Mj^ with fi=t — c. In this case acts 
as the scalar on A A A, so A A A = {¥p[t]/{t - c2)}»(»-i)/2. If c 7^ 1, then A A A ^ Mi and 
hence A A A (1 Y . But then a{a — l)/2 = dim(y4 A A) < dimF < 3, which is impossible. 
Therefore c = 1. Since g acts on V non-trivially, the action on B is non-trivial and A ^ B 
is the direct sum of a copies of B. 

Now take A = it Mi and B = ttY so that V = A (B B. Suppose that g acts on A as a 
scalar c. Since v > 7 and dimi? < dimF < 3, we see that a > 4, and by the claim, c = 1 
and A^ B is the direct sum of a copies of B. If B is the zero module, this contradicts the 
fact that g acts non-trivially on V. Otherwise, v — a > 0. Since B is the image of Y, it 
follows that A^ B CY, and a{v — a) < dimF < 3, which is false. Therefore g does not act 
on vrMi scalar, and hence does not act on Mi clS cL scalar. 
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We may assume that Mi = Mf where / has degree u over ¥p and Mi and Mivr have 
types a' and P' respectively, where /3 C a. Write a = (ai, . . . , a^) and /? = . . . , Ps)- 

Case 1: u > 1. 

Writing Smi for the number of submodules of Mi, we have 

Smi < Gmi/uiQ) 

Then 

Sm < SM^Qy{p) 

< c{pfD{pfp<'^+y''^ 

< C{pfD{pfp^"/''+''l^ 

< C{pfD{pfp^"'~^y'/'+'>/\ 

where the last line uses the fact that m > 14. Thus log^ Sm < C + (m — 4)^/4. 
Case 2: u = 1. 

In this case, f = t — c for some c G Fp. Since (7 does not act as a scalar on Mi or vrMi, 
we know a2 > P2 > 0. 
By Equation I6.3[ 

logp 5m < (a? + ■ ■ ■ + a^)/4 + re, 

so 

logp ^Af < logp Sm, + logp Gyip) <(«? + ■•• + a' + Z/')/4 + (r + 

Subcase 2.1: ai <m — A 
If r = 2, then 

logp^Af < {al + al + y^)/A + ?>e 

< ((m-4)2 + 42 + 0=^)/4 + 3e 

< (m- 4)2/4 + C. 



If r = 3, then 



< ((m-4)2 + 32 + l2 + 02)/4 + 4e 

< (m- 4)74 + a 
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Finally, if 4 < r < m, then by Lemma IA.6t we get 

logp^A/ < ((m-r)2 + r)/4+(r + l)£. 

The right-hand side is maximized at r = 4 or r = m. Since m > 45 and e < 6, it turns out 
that it is maximized at r = 4, where we get a bound of (m — 4)^/4 + 5e + 1. 

Subcase 2.2: ai > m — 3. 

So we may assume that ai > m — 3. Then 0^2 + ■ ■ ■ + + y < 3, and so + ■ ■ ■ + jSs + 
dim(7rF) < 3. Since + - ■ ■ + + dim(7rr) = v>10, it follows that A > 7 and /3i-/32 > 4. 
Note that /3i — (32 is the number of summands of vrMi that are isomorphic to Fp[t]/(/ — c). 
So write vrMi = A(B C, where a = dim A = jSi — (32 and g acts as the scalar c on A and not 
on C. Set -B = C © ttY. Then K = A © i? and by the claim, c = 1 and A -B is a direct 
sum of a copies of B. Then A® B is contained in Y plus the components of Mi that g does 
not act as a scalar on, so that a(32 < dim {A® B) < a2 + y < 3, which is impossible. □ 



6.2 A Proof of Theorem 2.6 



We can now prove Theorem 12.61 and Corollary 12. 7^ restated here for convenience. 

Theorem 12.61 Fix a prime p and integers d and n so that either n = 2 and d > 10 or n > 3 
and d >3. Let F be the free group of rank d and let dn be the dimension of Fn/ Fn+i- Let 



Cl 



C{j>fD{p)Y'^'^ ■■ n = 2 and d> 10 
C{pfD{p)p^/^ : n>3. 



Let 

C2 



-d : n = 2 
d^ - dnl2 : n>3. 



Then 
(a) 

(b) 

^ ^ \UA ^ 1 + cip^^ 



|S)d,n| l-Cip 

Proof. Let {Cd^nY be the set of elements of Cd^n fixed by g. Then |(Crf^„)^| is just the number 
of submodules of Fn/Fn+i viewed as a ¥p ((yf)-module. We explain first why only the identity 
element of GL{d,¥p) can act as a scalar on Fn/Fn+i- By Corollary 14.111 Fn/ F^+i has a 
FpGL((i, Fp)-submodule M which is isomorphic to an extension of V A V" by V^, where V is 
the natural FpGL((i, Fp)-module. If (7 G GL((i, Fp) acts on as a scalar c G Fp, then 
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it acts on V as the scalar c, and hence on A as the scalar c^. Thus c = and c = 1, so 
that g is the identity on V, that is, the identity element in GL(ci, Fp). 
Suppose first that n > 2. We know from Theorem 16.21 that if (7 7^ 1, 

By the Cauchy-Frobenius Lemma, 

\GL{d,¥p)\ ■ \€a,n\ = Yl 

geGL(d,Fp) 
= \Cd,n\ + ^ \{Cd,n)^\ 

< \Cd,n\ + (|GL(rf,F,)| - l)C(p)2D(p)^p('^"^2d„+2)/4_ 

By Equation and the fact that 2 - 9p(^~'^")/V2 > 1, 

\Cd,n\ > D{p)p^^/^-'/\ 

Since \GL{d,¥p)\ < it follows that 



\GL{d,¥p)\-\ 











< 1 + C{pf D{p) p«-2"!n+2)/4+d2-d2/4+l/4 

If ri = 2, then -F2/F3 is an extension of A by and using the estimates of Lemma [6.31 
and the argument above we obtain 



|GL(rf,Fp)|. 


^d,n 1 




\Cd,n 





< l+Cip"^. 

This proves part (a). 

To prove part (6), we observe that \Cd^n\ = X] |GL((i, Fp)|/|GL((i, Fp)(^)|, where the sum 
is over all GL{d, Fp)-orbits in Cd,n and |GL((i, Fp)(^)| is the order of the stabilizer in GL{d, ¥p) 
of any element w of the orbit under consideration. Now \T)d,n\ is just the number of orbits 
for which |GL((i, Fp)(^) | = 1, so 

\Cd,n\ < \GL{d,¥p)\ ■ + \GL{d,¥p)\{\(Ea,n\ - \^d,n\)/2. 

That is, 

(2/|GL(t;,Fp)|)|C,,„| - \(id,n\ < \^d,nl 
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so that 



IS 



d,n 



< 



< 



< 









2|C,,„|/|GL(rf,Fp)|- 









i,n 


\-\GUd,¥,)\/\Q,n\ 




2 - 




^d,n 


■|GL(rf,Fp)|/|C,,„| 



Corollary 6.4. Ifn>2, then 



Ifd>3, then 



1 + 

1 - CiJ9^2 



iim — — - = 1. 

d-*oo \(LdJ 



\'^d,n\ 

lim — — - = 1. 



□ 



If n = 2 and d > 10, or n > 3 and d > 5, or n > 4 and d > 3, then 

1- \'^d,n\ 

lim = 1 

Proof. It is clear from Theorem 12.61 that the first two limits hold. For the third limit, note 
that by Lemma IA.4I Equation IA.5t 

d'^ - dn/2 < -3/4 

for all values of d and n for which Equation IA.5I holds. For the finitely many values of d and 
n for which Equation IA.5I does not hold but n = 2 and > 10, or > 3 and > 5, or > 4 
and c? > 3, a computer check shows that 

d^ - dn/2 < -3/4. 

Combined with Theorem 12.61 this shows that 

T . I ^d,n I T 

lim = 1 

for the given values of d and n. □ 
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Chapter 7 



A Survey on the Automorphism 
Groups of Finite p-Groups 

This chapter constitutes a survey of some of what is known about the automorphism groups 
of finite p-groups. The focus is on three topics: exphcit computations for famihar finite 
p-groups; constructions of finite p-groups whose automorphism groups satisfy certain con- 
ditions; and the discovery of finite p-groups whose automorphism groups are or are not 
p-groups themselves. 

7.1 The Automorphisms of Famihar ^^-Groups 

There are several familiar families of finite p-groups for which some information about their 
automorphism groups is known. In particular, for a couple of these families, the automor- 
phism groups have been described in a reasonably complete manner. The goal of this section 
to present these results as concretely as possible. We begin with a nearly exact determina- 
tion of the automorphism groups of the extraspecial p-groups. The next subsection discusses 
the maximal unipotent subgroups of Chevalley groups, for which Gibbs [31] describes six 
types of automorphisms that generate the automorphism group. For type Ae, Pavlov [80j 
and Weir [91] have (essentially) computed the exact structure of the automorphism group. 
The last three subsections summarize what is known about the automorphism groups of 
the Sylow p-subgroups of the symmetric group, p-groups of maximal class, and certain stem 
covers. We note that Barghi and Ahmedy [6] claim to determine the automorphism group 
of a class of special p-groups constructed by Verardi [90]; unfortunately, as pointed out in 
the MathSciNet review of [6], the proofs are incorrect. 

7.1.1 The Extraspecial j3-Groups 

Winter [HZ] gives a nearly complete description of the automorphism group of an extraspe- 
cial p-group. (Griess [35] states many of these results without proof.) Following Winter's 
exposition, we will present some basic facts about extraspecial p-groups and then describe 
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their automorphisms. 

Recall that a finite p-group G is special if either G is elementary abelian or Z{G) = G' = 
Furthermore, a non-abelian special p-group G is extraspecial if Z{G) = G' = = 
Cp. The order of an extraspecial p-group is always an odd power of p, and there are two 
isomorphism classes of extraspecial p-groups of order p^n+i each prime p and positive 
integer n, as proved in Gorenstein [531 Theorem 5.2]. When p = 2, both isomorphism classes 
have exponent 4. When p is odd, one of these isomorphism classes has exponent p and the 
other has exponent p"^. 

Any extraspecial p-group G of order p^n+i j^^^g generators Xi,X2, ■ ■ ■ ,X2n satisfying the 
following relations, where 2; is a fixed generator of Z{G): 

[x2i-i,X2'i] = z for 1 < z < n, 

[xi, Xj] = 1 for 1 < i,j < n and |z — j| > 1, and 

G Z{G) for 1 < i < 2n. 

When p is odd, either = 1 for 1 < z < 2n, in which case G has exponent p, or Xi = z 
and x\ = 1 for 2 < z < 2r;,, in which case G has exponent p^. When p = 2, either xf = 1 for 
1 < 2 < 2?7,, or xi = X2 = z and xf = 1 for 3 < z < 2n. 

Recall that if two groups A and S have isomorphic centers Z{A) = Z{B), then the central 
product of A and B is the group 

{AxB)/{{z,<P{z)-') : ZGZ(A)}. 

All extraspecial p-groups can be written as iterated central products as follows. If p is odd, 
let M be the extraspecial p-group of order p^ and exponent p, and let be the extraspecial 
p-group of order p^ and exponent p^. The extraspecial p-group of order p2"+i and exponent 
p is the central product of n copies of M, while the extraspecial p-group of order p2"+i and 
exponent p^ is the central product of n — 1 copies of M and one copy of A^. If p = 2, the 
extraspecial 2-group of order 2^"+^ and xf = X2 = 1 is isomorphic to the central product 
of n copies of the dihedral group Dg, while the extraspecial 2-group of order 2^""*"^ and 
xl = X2 = z is isomorphic to the central product of n — 1 copies of Dg and one copy of the 
quaternion group Qg. 

One of the isomorphism classes can be viewed more concretely. The group of [n + 1) x 
{n + 1) matrices with ones on the diagonal, arbitrary entries from ¥p in the rest of the first 
row and last column, and zeroes elsewhere is an extraspecial p-group of order p2"-+i. When 
p is odd, this is the extraspecial p-group of exponent p. When p = 2, this is the central 
product of n copies of Dg. 

In [27], Winter states the following theorem on the automorphism groups of the ex- 
traspecial p-groups for all primes p (an explicit description of the automorphisms follows the 
theorem). 

Theorem 7.1 (Winter [97]). Let G be an extraspecial p-group of order p^'^^^ . Let I = Inn(G') 
and let H he the normal subgroup of Ant (G) which acts trivially on Z{G). Then 
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2. Aut(G') = H xi (6), where 9 is an automorphism of order p — 1. 

3. If p is odd and G has exponent p, then H/I = Sp{2n,¥p) , and the order of H/I is 



4- If p is odd and G has exponent p^ , then H/I = Q xi Sp{2n — 2,Fp), where Q is a 
normal extraspecial p- group of order p'^"'~^ , and the order of H/I is p" YYi=i ip'^^ ~ -'-)■ 
The group Q x Sp(2n — 2, Fp) is isomorphic to the subgroup o/Sp(2n, Fp) consisting of 
elements whose matrix (ay) with respect to a fixed basis satisfies an = 1 and = 
for i > 1. 

5. If p = 2 and G is isomorphic to the central product of n copies of Dq, then H/I 
is isomorphic to the orthogonal group of order 2"("~^)+i(2"' — 1)11^=/ (^^^ ~ ^) ^^^^ 
preserves the quadratic form ^iC,2 + ^3^4 + ■ ■ ■ + Gn-i^2n over ¥2- 

6. If p = 2 and G is isomorphic to the central product of n — 1 copies of and one 
copy of Qs, then H/I is isomorphic to the orthogonal group of order 2"'("'~^)+^(2"' + 
1) nr=/ (2^* - 1) that preserves the quadratic form ^.1^.2+^3^-^ H^|„_i+6n-i6n+^L 



The automorphisms in Aut(G') can be described more exphcitly. First, the automorphism 
6 may be chosen as follows. Let m be a primitive root modulo p with < m < p. Then 
define 6 by 6{x2i-i) = a^2i-i ^"^^ (^{^21) = ^21 for 1 < i < n and by 9{z) = z"^. Next, the 
inner automorphisms are the p^" automorphisms a such that a{z) = z and o"(xj) = XiZ'^^ for 
each i and some choice of integers < di < p. 

It remains to describe H. For each x E G, let x denote the coset xZ{G). Now G/Z{G) 
becomes a non-degenerate symplectic space over Fp with the symplectic form {x,y) = a, 
where [x,y] = z" and < a < p. The symplectic group Sp(2n,Fp) acts on G/Z{G), 
preserving the given symplectic form. Let T G Sp(2n, Fp) and let A = (ay) be the matrix 
of T relative to the basis {xj} (with < aij < p). Each element x E G can be uniquely 
expressed (nii^f) 2" with < Oj, c < p. Define : G — G by 



Then induces T on G/Z{G), and is an automorphism of G if and only if T is in the 
subgroup of Sp(2n, Fp) to which H/I is isomorphic (as given in statement 3, 4, 5, or 6 of 
Theorem I7.H depending on p and the isomorphism class of G) . 

Note that the set of automorphisms does not necessarily constitute a subgroup of H, 
and so it is not obvious that H splits over / (and Winter does not address this issue). 
However, as Griess proves in [35], when p = 2, H splits if n < 2 and does not split if n > 3. 
Griess also states, but does not prove, that when p is odd, H always splits over /. This 



over ¥2- 




z' 



,c 
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Type 


Chevalley Group 


A, 

c, 


PSL,+i(F,) 
P(OWi(^q)) 

PSp2£(Fq) 
P(0^,(Fq)) 



Table 7.1: The Chevalley groups of types 
Ai, Be, Ci and Di. 



observation is also made in, and can be deduced from, Isaacs [50] and jST] and Glasby and 
Howlett [32]. 

A short exposition of this proof when p is odd and G has exponent p was communicated 
via the group-pub-forum mailing list by Isaacs [52j. Let J/ 1 be the central involution of 
the symplectic group H/I, and let P be a Sylow 2-subgroup of J. Then J is normal in H, 
\P\ = 2, and the non-identity element of P acts on I by sending each element to its inverse. 
Then 1 = Cj{P) = I (1 Nh{I)- On the other hand, by the Frattini argument, H = JNh{P), 
and since P < J n Nh{P), it follows that H = INh{P)- But this means that Nh{P) is a 
complement of / in H, and so H splits over I. According to Griess [35], the proof when G 
has exponent p"^ is more technical. 

7.1.2 Maximal Unipotent Subgroups of a Chevalley Group 

Associated to any simple Lie algebra C over C and any field K is the Chevalley group G of 
type C over K. Table 17.11 lists the Chevalley groups of types Ai, Bi, Ci, and over the 
finite field ¥g, as given in Carter [12]. A few clarifications are necessary: the entry for type 
Bi requires that ¥q have odd characteristic; 02e+i(¥q) is the orthogonal group which leaves 
the quadratic form ^1^2 + (,3^,4: + ■ ■ ■ + ^2e-iC,2i + ^21+1 invariant over F^; and 02^(Fg) is the 
orthogonal group which leaves the quadratic form ^1^2 + ^3^4 + ■ ■ ■ + ■^2^-1^2^ invariant over 
¥q. Gibbs [31j examines the automorphisms of a maximal unipotent subgroup of a Chevalley 
group over a field of characteristic not two or three. We are only interested in finite groups, 
so from now on we will let K = ¥q, where F^ has characteristic p > 3 and q = p^. In this 
case, the maximal unipotent subgroups are the Sylow p-subgroups of the Chevalley group. 
After some preliminaries on maximal unipotent subgroups, we will present his results. 

Let E, S"*", and vr denote the sets of roots, positive roots, and fundamental roots, respec- 
tively, of £, relative to some Cartan subalgebra. Then the Chevalley group G is generated by 
{xrif) : r G S,t G F^}. One maximal unipotent subgroup [/ of G is constructed as follows. 
As a set, 

U = {xr{t) : r G G Fj. 

For any r, s G S+ and t, -u G ¥g, the multiplication in U is given by 

Xr(t)Xr{u) = Xr(t + u) 
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{1 : r + s is not a root 

n Xir+jsiCij,rsi-tyu^) ■ r + s is a root. 

Here i and j are positive integers and Cij^rs are certain integers which depend on C. The 
order of U is , where N = and U is a Sylow p-subgroup of G. 

Gibbs [31] shows that Aut(G) is generated by six types of automorphisms, namely graph 
automorphisms, diagonal automorphisms, field automorphisms, central automorphisms, ex- 
tremal automorphisms, and inner automorphisms. Let the subgroup of Aut(G') generated 
by each type of automorphism be denoted by P, D, F, C, E, and / respectively. Let Pr be 
the additive group generated by the roots of C and let r^v be the highest root. Label the 
fundamental roots ri, r2, . . . , r^. 

1. Graph Automorphisms: An automorphism a of Pr that permutes both tt and S induces 
a graph automorphism of U by sending Xr(t) to Xo-{r){t) for all r G tt and t E¥g. Graph 
automorphisms correspond to automorphisms of the Dynkin diagram, and so types 
Ai {£ > 1), Di > 4), and Eq have a graph automorphism of order 2, while the graph 
automorphisms in type D4 form a group isomorphic to 5*3. 

2. Diagonal Automorphisms: Every character x of Pr with values in F* induces a diagonal 
automorphism which maps Xr{t) to Xr{x{f)t) for all r G S+ and t G Fg. 

3. Field Automorphisms: Every automorphism a of induces a field automorphism of 
U which maps Xr{t) to Xr{(j{t)) for all r G E"*" and t G Fg. 

4. Gentral Automorphisms: Let cTj be endomorphisms of F^. These induce a central 
automorphism that maps Xnit) to Xriit)xrN{o'i(t)) for i = 1, . . . , i and all t G Fg. 

5. Extremal Automorphisms: Suppose rj is a fundamental root such that rjv — Tj is also a 
root. Let m G F*. This determines an extremal automorphism which acts trivially on 

. (t) for i ^ j and sends Xr^ (t) to 

Xrj (t^Xrpf—rj {ut)Xrpf ( (1/2) A^f at— ,rj ) • 

Here Nr^-r-,r- is a certain constant that depends on the type. In type Q, r^v — 2rj is 
also a root, and the map that acts trivially on Xi{t) for i ^ j and sends Xr^{t) to 

Xr^{t)Xrj,-2T,{ut)Xrt,-r,{{l/'^)Nrj,-2r,,T,Ut^)Xrr,{{l/^)Ci2,rN~T,,r,Ut^ 

is also an automorphism of U . 

Steinberg [88] showed that the automorphism group of a Chevalley group over a finite 
field is generated by graph, diagonal, field, and inner automorphisms, which shows that P, 
D, and F are, in fact, subgroups of Aut(f/). It is easy to see that the central automorphisms 
are automorphisms, and a quick computation verifies this for the extremal automorphisms 
as well. Note that by multiplying an extremal automorphism by a judicious choice of central 
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automorphism, the Xrj^{-) term in the description of the extremal automorphisms disap- 
pears. Therefore, it is legitimate to omit the Xr^(-) term in the definition of an extremal 
automorphism, and this is what we will use for what follows. 

Gibbs does not compute the precise structure of Aut(f/). This has been done in type 
Ai, however, for all characteristics; Pavlov [80] computes Aut(f/) over Fp, while Weir 
computes it over Fg (although his computations contain a mistake which we will address in 
a moment). We will present the result for type Ai as explicitly as possible, pausing to note 
that it does seem feasible to compute the structure of Aut(f/) for other types in a similar 
manner. 

As mentioned before, in type Ai, we can view U as the set of (£ + 1) x (£+ 1) upper trian- 
gular matrices with ones on the diagonal and arbitrary entries from ¥q above the diagonal. 
There are (^2^) positive roots in type Ai, given by + rj+i + ■■■ + rj for 1 < i < j < i. Let 
Eij be the {£ + 1) x [i + 1) matrix with a 1 in the (z, j)-entry and zeroes elsewhere. Then 
Xr(t) = I + tEij, where r = rj-|-rj+i + - ■ ■ + rj. In particular, x^it) = I + tEi^i+i. In type Ai, 
some of the given types of automorphisms admit simpler descriptions; we will be content to 
describe their action on the elements XrXt)- 

As mentioned, in type A^ there is one nontrivial graph automorphism of order 2, and 
it acts by sending ^^-(t) to Xr„_f_j^_Xt) ■ The diagonal automorphisms correspond to selecting 
Xi,---,Xn £ and mapping Xnit) to XniXit)- This is equivalent to conjugation by a 
diagonal matrix of determinant 1. The diagonal automorphisms form an elementary abelian 
subgroup of order {p — 1)"^^. The field automorphisms of F^ are generated by the Frobenius 
automorphism and form a cyclic subgroup of order n. 

Let ai, . . . ,a„ generate the additive group of ¥q. Then the elements Xniaj) for i,j = 
1, . . . ,n generate U. The central automorphisms are generated by the automorphisms rj" 
which send Xr^ (am) to Xr^ (am)xr^(l) and fix Xni^-k) for i ^ j and k ^ m, where j = 2, . . . , £— 
1 and m = 1, . . . ,n. (When j = 1 or j = i, this automorphism is inner.) The extremal 
automorphisms are generated by the automorphism that sends Xri(t) to Xr-i^{t)xrr^-ri(t) and 
fixes XrXt) for 2 < i < i and the automorphism that sends ^^^(t) to ^^^(t)^^^-,-^ (t) and fixes 
Xri{t) for 1 < i < i — 1. Finally the inner automorphism group is, of course, isomorphic to 
U/Z{U) (the center of U is generated by Xr^it)). 

It is not hard to use these descriptions to deduce that 

Aut(t/) ^ ((/ X (E X C)) X (D X F)) X P. 

Furthermore ExC is elementary abelian of order g'^(^-2)+2^ jj jg elementary abelian of order 
{q — iy, F is cyclic of order n, and I has order q^^ +^-2)/2_ follows that the order of Aut(f/) 
is 

2n{q - lYq{^'+^+^nl-An+2)/2_ 

The error in Weir's paper [9l| stems from his claim that any g G GL„(Fp) acting on 
Fg induces an automorphism of U that maps Xr-Xo-k) to x^Xdi^k))-, generalizing the field 
automorphisms. However, it is clear that g must, in fact, be a field automorphism, as for 
any t, m G Fg, 

[Xri(t),Xr2(w)] = Xr^+r2{iu) = [x^^ (tw) , X^-j (1)] . 
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Applying g to all terms shows that g{tu) = g{t)g{u). 

7.1.3 Sylow j9- Subgroups of the Symmetric Group 

The automorphism groups of Sylow p-subgroups of the symmetric group for p > 2 were 
examined independently by Bondarchuk [9] and Lentoudis [60l EH [621 [63] . Their results are 
reasonably technical. They do show that the order of the automorphism group of the Sylow 
p-subgroup of Sprn is 

■ ■ ■ + + 2 '^"^^ — m + 2)p — 1. 
isomorphic to the m-fold iterated wreath product 



7.1.4 j3-Groups of Maximal Class 

A p-group of order is of maximal class if it has nilpotence class n — 1. Many examples 
are given in ^9] Examples 3.1.5], with the most familiar being the dihedral and quaternion 
groups of order 2" when n > A. It is not too hard to prove some basic results about the 
automorphism group of an arbitrary p-group of maximal class. Our presentation follows 
Baartmans and Woeppel ^ Section 1]. 

Theorem 7.2. Let G be a p-group of maximal class of order p", where n > 4 and p is 
odd. Then Aut((j) has a normal Sylow p-suhgroup P and P has a p' -complement H , so that 
Aut(G) = H XI P. Furthermore, H is isomorphic to a subgroup of Cp^i x Cp_i. 

The proof of this theorem begins by observing that G has a characteristic cyclic series 
G = Go > Gi > ■ ■ ■ > Gn = 1; that is, each Gi is characteristic and Gi/Gi^i is cyclic (see 
Huppert [m, Lemmas 14.2 and 14.4]). By a result of Durbin and McDonald [25], Aut(G) 
is supersolvable and so has a normal Sylow p-subgroup P with p'-complement H, and the 
exponent of Aut(G) divides p*(p — 1) for some t > 0. The additional result about the 
structure of H comes from examining the actions of H on the characteristic cyclic series and 
on G/^{G). Baartmans and Woeppel remark that the above theorem holds for any finite 
p-group G with a characteristic cyclic series. 

Baartmans and Woeppel [1] follow up these general results by focusing on automorphisms 
of p-groups of maximal class of exponent p with a maximal subgroup which is abelian. More 
specifically, the characteristic cyclic series can be taken to be a composition series, in which 
case Gi = 'ji{G) for i > 2 and Gi = 6*0(^2/(^4). Baartmans and Woeppel assume that G2 
is abelian. 

In this case, they show by construction that H = Cp_i x Cp_i. Furthermore, P is 
metabelian of nilpotence class n — 2 and order p^""'^. (Recall that a metabelian group is 
a group whose commutator subgroup is abelian.) The group Inn(G') has order p"~^ and 



where 



n{m) =p™-i +p™-2 



Note that the Sylow-p subgroup of Sp^ is 



of C„. 
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maximal class n — 2. The commutator subgroup P' is the subgroup of Inn(G') induced 
by G2- Baartmans and Woeppel do explicitly describe the automorphisms of G, but the 
descriptions are too complicated to include here. 

Other authors who investigate automorphisms of certain finite p-groups of maximal class 
include: Abbasi [1]; Miech [70], who focuses on metabelian groups of maximal class; and 
Wolf [98j, who looks at the centralizer of Z{G) in certain subgroups of Aut(G). 

Finally, in [53] , Juhasz considers more general p-groups than p-groups of maximal class. 
Specifically, he looks at p-groups G of nilpotence class n — 1 in which 71(G) /72(G) = G^™ x 
Cpm and 7i(G)/7i+i(G) = Cpm for 2 < i < n — 1. He refers to such groups as being of type 
(n, m). Groups of type (n, 1) are the p-groups of maximal class of order p". 

Assume that n > 4 and p > 2. As with groups of maximal class, the automorphism 
group of a group G of type (n, m) is a semi-direct product of a normal Sylow p-subgroup P 
and its p'-complement if, and H is isomorphic to a subgroup of Gp_i x Gp_i. Juhasz' results 
are largely technical, dealing with the structure of P, especially when G is metabelian. 

7.1.5 Stem Covers of an Elementary Abelian ^- Group 

In [nS], Webb looks at the automorphism groups of stem covers of elementary abelian p- 
groups. We start with some preliminaries on stem covers. A group G is a central extension 
of Q by if is a normal subgroup of G lying in Z{G) and G/N = Q. UN lies in [G, G] as 
well, then G is a stem extension of Q. The Schur multiplier M{Q) of Q is defined to be the 
second cohomology group H^{Q,C*), and it turns out that A^ is isomorphic to a subgroup 
of M{Q). Alternatively, M{Q) can be defined as the maximum group A^ so that there exists 
a stem extension of Q by A^. Such a stem extension is called a stem cover. 

Webb takes Q to be elementary abelian of order p" with p odd and n > 2. Let G be a 
stem cover of Q. Then A^ = Z{G) = [G, G] = M{Q) = Q AQ and has order p("^\ Therefore 
Autc(G) are the automorphisms of G which act trivially on G/N = Q. Each automorphism 
a G Autc(G) corresponds uniquely to a homomorphism a G B.om{Q, N) via the relationship 
a{gN) = ■ a{g) for all g E G. Of course, Hom(Q, A^) is an elementary abelian p-group 
of order n(/^), and so Aut(G) is an extension of a subgroup of Aut{Q) = GL(n, Fp) by an 
elementary abelian p-group of order n(^y Webb proves that the subgroup of Aut{Q) in 
question is usually trivial, leading to her main theorem. 

Theorem 7.3 (Webb [93]). Let G be elementary abelian of order p'^ with p odd. As n ^ cxd, 
the proportion of stem covers of G with elementary abelian automorphism group of order 
p"(2) tends to 1. 

7.2 Quotients of Automorphism Groups 

Not every finite p-group is the automorphism group of a finite p-group. A recent paper in 
this vein is by Cutolo, Smith, and Wiegold [18], who show that the only p-group of maximal 
class which is the automorphism group of a finite p-group is -Dg. But there are several extant 
results which show that certain quotients of the automorphism group can be arbitrary. 
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7.2.1 The Quotient Aut(G')/Autc(G) 



Theorem 7.4 (Heineken and Liebeck [3B])- Let K be a finite group and letp be an odd prime. 
There exists a finite p-group G of class 2 and exponent p^ such that Aut(G')/Autc(G') = K . 

The construction given by Heineken and Liebeck can be described rather easily. Let K 
be a group generated by elements xi,X2, . . . ,Xd- Let D\K) be the directed Cayley graph 
of K relative to the given generators. Form a new digraph D{K) by replacing every arc in 
D'{K) by a directed path of length i if the original arc corresponded to the generator x,. 
Then Aut(D(ir)) = K. 

Let t>i, t>2, . . . , fm be the vertices of D{K). Let G be the p-group generated by elements 
vi,V2,...,Vm where 

1. G' is the elementary abelian p-group freely generated by 

{[vi^Vj] : I <i < i <m}. 

2. For each vertex f if Vi has outgoing arcs to f j^, f jj, . . . , f j^, then 

Heineken and Liebeck show that Aut(G')/Autc(G') = K when \K\ > 5. (They give a special 
construction for \K\ < 5.) As Webb [93J notes, G is a special p-group. 

They are actually able to determine the automorphism group of G much more precisely, 
at least when \K\ > 5. Let the vertices of D'{K) be called group-points; they are naturally 
identified with vertices of D[K). Let S be the set of vertices of D{K) consisting of the group- 
point e corresponding to the identity of K and all vertices that can be reached along a directed 
path from e that does not pass through any other group-points. Assume that the vertices 
of D{K) are labeled so that Vi, . . . ,Vs are the elements of 5*. The central automorphisms 
which fix Vs+i,Vs+2, ■ ■ ■ ,Vm generate an elementary abelian p-group U of dimension s\G'\ = 
{l/2)ks'^{ks — 1). Every central automorphism of G is of the form YIv^k'^'^'^vV, where the 
elements & U and v E K are uniquely determined. Thus Autc(G) is the direct product of 
the conjugates of U in Aut(G) and Aut(G) = U I K. It follows that Aut(G) has order kp^, 
where i = {l/2)k'^s^{ks - 1) and s = {l/2)d{d + l when d>2 and s = 1 when d=l. 

Lawton [57] modifies Heineken and Liebeck's techniques to construct smaller groups G 
with Aut(G)/Autc(G') = K. He uses undirected graphs which are much smaller, and the 
p-groups he defines is significantly simpler. 

Webb [92] uses similar, though more complicated techniques, to obtain further results. 
She defines a class of graphs called Z -graphs; it turns out that almost all finite graphs are 
Z-graphs (that is, the proportion of graphs on n vertices which are Z-graphs goes to 1 as 
n goes to infinity). To each Z-graph A, Webb associates a special p-group G for which 
Aut(G)/Autc(G') = Aut(A). The set of all special p-groups that arise from Z-graphs on n 
vertices is denoted by ^(p, n). 
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Theorem 7.5 (Webb). Let p be any prime. Then the proportion of groups in Qp^n whose 
automorphism group is {CpY , where r = — l)/2, goes to 1 as n oo. 

The reason the group {CpY arises as the automorphism group is that for G G Q{p,n), 
Autc(G') is isomorphic to Hom(G/Z(G), Z(G)), and hence it is isomorphic to {CpY- Webb 
then shows that Aut(G')/Autc(G') is usually trivial. 

Theorem 7.6 (Webb). Let K be a finite group which is not cyclic of order five or less. Then 
for any prime p, there is a special p- group G G Q{p, 2|i^'|) with Aut(G')/Autc(G') = K. 

In particular, Theorem 17.61 extends Heineken and Liebeck's result to the case p = 2. Note 
that in Theorems 17.41 and 17.61 the constructed groups are special and Autc(G) = Aut/(G), 
so that these theorems also prescribe Aut(G')/Aut/(G'). The p = 2 analogue of Heineken 
and Liebeck's result was discussed by Hughes [47j . 

7.2.2 The Quotient Aut(G)/Aut/(G') 

Bryant and Kovacs liQ\ look at prescribing the quotient Aut(G)/Aut/(G'), taking a different 
approach from Heineken and Liebeck in that they assign Aut(G)/Aut/(G) as a linear group 
(and they do not bound the class of G). 

Theorem 7.7 (Bryant and Kovacs [ID]). Let p be any prime. Let K be a finite group with 
dimension d > 2 as a linear group over ¥p. Then there exists a finite p-group G such that 
Aut(G')/Autj(G') ^ K and d{G) = d. 

This theorem is non-constructive, in contrast to the results of Heineken and Liebeck. To 
understand the main idea, let F be the free group of rank d. By Theorems 13.71 and 13. 8[ 
if Z7 is a normal subgroup of F with Fn+i < U < Fn, then G = F/U is a. finite p-group 
and Aut(G)/Aut/(G) is isomorphic to the normalizer of U in GL{d,¥p). Bryant and Kovacs 
show that if n is large enough, then Fn/Fn+i contains a regular FpGL((i, Fp)-module, which 
shows that any subgroup K of GL((i, Fp) occurs as the normalizer of some normal subgroup 
U oiF with Fn<U < F^+i- 

7.3 Orders of Automorphism Groups 

The first two subsections in this section describe some general theorems about the orders 
of automorphism groups of finite p-groups. The third subsection gives the order of the 
automorphism group of an abelian p-group, and the last subsection offers many explicit 
examples of p-groups whose automorphism group is a p-group. As proved in Chapters [2] 
through El in some asymptotic senses, the automorphism group of a finite p-group is almost 
always a p-group. However, as mentioned in Section [231 the answer to the following question 
is unknown. 

Question. Let Wp^n be the proportion of p-groups with order at mostp" whose automorphism 
group is a p-group. Is it true that lim„^oo Wp^n = 1 ? 
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7.3.1 Nilpotent Automorphism Groups 

In [99], Ying states two results about the occurrence of automorphism groups of p-groups 
which are p-groups, the second being a generahzation of a result of Heineken and Liebeck [37j. 

Theorem 7.8. If G is a finite p-group and Aut(G') is nilpotent, then either G is cyclic or 
Aut(G') is a p-group. 

Theorem 7.9. Let p be an odd prime and let G be a finite p-group generated by two elements 
and with cyclic commutator subgroup. Then Aut(G) is not a p-group if and only if G is the 
semi-direct product of an abelian subgroup by a cyclic subgroup. 

Heineken and Liebeck [37J also have a criterion which determines whether or not a p- 
group of class 2 and generated by two elements has an automorphism of order 2 or if the 
automorphism group is a p-group. If p is an odd prime and G is a p-group that admits 
an automorphism which inverts some non-trivial element of G, then G is an s.i. group (a 
some-inversion group). Clearly if G is an s.i. group, it has an automorphism of order 2. If 
G is not an s.i. group, it is called an n.i. group (a no-inversion group). 

Theorem 7.10. Let p be an odd prime and let G be a p-group of class 2 generated by two 
elements. Choose generators x and y such that 

{x,G')n{y,G') = G', 

and suppose that 

{x) nG' = {xP"^) and {y) nG' = {y^") . 

1. If either x^" = 1 or y'^" = 1, then G is an s.i. group. 

2. If x^"" = [x, 7/]'"^'° 7^ 1 and y^" = [x, y]'^^' ^ 1 with {r,p) = {s,p) = 1, and [n — I + k — 
m){k — V) is non-negative, then G is an s.i. group. 

3. If k and I are defined as in (2) and {n — I + k — m){k — I) is negative, then G is an n.i. 
group and its automorphism group is a p-group. 

7.3.2 Wreath Products 

For any group G, let 7r(G') be the set of distinct prime factors of In [16], Horosevskii gives 
the following two theorems on the order of the automorphism group of a wreath product. 

Theorem 7.11. Let G and H be non-trivial finite groups, and let Gi be a maximal abelian 
subgroup of G which can be distinguished as a direct factor ofG. Then 

7r(Aut(G I H)) = n{G) U tt{H) U 7r(Aut(G)) U n{Aut{H)) U 7r(Aut(Gi I H)). 

Theorem 7.12. Let Pi, P2, . . . , Pm be non-trivial finite p-groups. Then 

m 

7r(Aut(Pi lP2l---lPm)) = [j 7r(Aut(P,)) U {p}. 

i=l 

Thus given any finite p-groups whose automorphism groups are p-groups, we can con- 
struct infinitely many more by taking iterated wreath products. 
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7.3.3 The Automorphism Group of an Abehan j9-Group 

Macdonald [661 Chapter II, Theorem 1.6] calculates the order of the automorphism group of 
an abelian p-group using Hall polynomials. 

Theorem 7.13. Let G be an abelian p-group of type A. Then 

|Aut(G)|=pl^l+2"Wn'^™«w(P"')' 
where mj(A) is the number of parts of X equal to i, n{X) = J2i>i ('2)' ^'^^ (pmit) = {l — t){l — 

There are a variety of results in the literature on the automorphism groups of abelian p- 
groups, of which we will mention three that are interesting and not so technical. Morgado [721 
[75] proves the following theorem about the splitting of the sequence 1 K{G) Aut(G) 
A{G) — > 1 described in Chapter [31 

Theorem 7.14. Let G be an elementary abelian p-group. Let K{G) be the subgroup of 
Aut(G') that acts trivially on G/^{G) and let A{G) be the subgroup o/Aut(G/$(G)) induced 
by the action of Ant{G) on G/^{G). If p > 5, then the exact sequence 1 — > K{G) — >■ 
Aut(G') — » A{G) 1 splits if and only G has type {p"^,p, ■ ■ ■ ,p) for some positive integer 
m. If p = 2 or p = 3, this condition is sufficient but not necessary. 

In a similar vein, Avino discusses the splitting of Aut(G) over a different naturally defined 
normal subgroup. A different type of result comes from Abraham [2], who shows that for 
any integer n > and for p > 3, the automorphism group of any abelian p-group G contains 
a unique subgroup which is maximal with respect to being normal and having exponent at 
most p". 

7.3.4 Other j9-Groups Whose Automorphism Groups are j9-Groups 

In this subsection, we collect constructions of finite p-groups whose automorphism groups 
are p-groups. 

The first example of a finite p-group whose automorphism group is a p-group was given by 
Miller [TTj, who constructed a non-abelian group of order 64 with an abelian automorphism 
group of order 128. Generalized Miller's construction, Struik [89] gave the following infinite 
family of 2-groups whose automorphism groups are abelian 2-groups: 

G = (^a,b,c,d : = 6^ = = c?^ = 1, 

[a, c] = [a, d\ = [b, c] = [c, d] = 1, bab = oF ^ , bdb = cdj , 

where n > 3. {G can be expressed as a semi-direct product as well.) Struik shows that 
Aut(G) = (Cs)^ X C2n-2. (As noted in [89], it turns out that Macdonald [651 P- 237, 
Revision Problem #46] asks the reader to show that Aut(G') is an abelian 2-group.) Also, 



68 



Jamali [53] has constructed, for m > 2 and n > 3, a non-abelian n-generator group of order 
22n+m-2 -^j^j-^ expoucut 2™ and abelian automorphism group (C2)" x 02^-2. 

More examples of 2-groups whose automorphism groups are 2-groups are given by New- 
man and O'Brien [77]. As an outgrowth of their computations on 2-groups of order dividing 
128, they present (without proof) three infinite famihes of 2-groups for which \G\ = |Aut(G')|. 
They are, for n > 3, 

1. C2"~i X 

2. (a, 6 : a^"-^ =b^ = l^a' = and 

3. (a, 6, c : a2"-' = = = [b, a] = l,a^ = a'+^"~\ ¥ = ba^^'^y 

Moving on to finite p-groups where p is odd, for each n > 2 Horosevskii [15] constructs 
a p-group with nilpotence class n whose automorphism group is a p-group, and for each 
d > 3 he constructs a p-group on d generators for each d > 3 whose automorphism group is 
a p-group. (He gives explicit presentations for these groups.) 

Cur ran [15j shows that if {p — 1,3) = 1, then there is exactly one group of order whose 
automorphism group is a p-group (and it has order p^). It has the following presentation: 

G = {a,b : bP=[a, b]P = [a, b, bf = [a, b, b, bf = [a, b, b, b, b] = 1, 
aP = [a,b,b,b] = [b,a,b]-'^) . 

When (p — 1, 3) = 3, there are no groups of order p^ whose automorphism group is a p-group. 
However, in this case, there are three groups of order p^ which have no automorphisms of 
order 2. Curran also shows that p^ is the smallest order of a p-group which can occur as an 
automorphism group (when p is odd). 

Then, in [16], Curran constructs 3-groups G of order 3" with n > 6 where |Aut(G)| = 3"^^ 
and p-groups G for certain primes p > 3 with |Aut(G')| = p\G\. The MathSciNet review 
of [15] remarks that F. Menegazzo notes that for odd p and n> 3, the automorphism group 
of 

G = (^a,b : = l,lf" = aP"~\a' = a^+f) 

has order p\G\. 

Ban and Yu ^ prove the existence of a group G of order p" with |Aut(G)| = p""^^, for 
p > 2 and n > 6. In [37], Heineken and Liebeck construct a p-group of order p^ and exponent 
p^ for each odd prime p which has an automorphism group of order p^°. 

Jonah and Konvisser [5l] exhibit p + 1 nonisomorphic groups of order p^ with elementary 
abelian automorphism group of order p^^ for each prime p. All of these groups have elemen- 
tary abelian and isomorphic commutator subgroups and commutator quotient groups, and 
they are nilpotent of class two. All their automorphisms are central. 

Malone [HZ] gives more examples of p-groups in which all automorphisms are central: for 
each odd prime p, he constructs a nonabelian finite p-group G with a nonabelian automor- 
phism group which comprises only central automorphisms. Moreoever, his proof shows that 
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if F is any nonabelian finite p-group with F' = Z{F) and Autc(-F) = Aut(-F), then the direct 
product of F with a cychc group of order p has the required property for G. 

Caranti and Scoppola [TT] show that for every prime p > 3, iin >6, there is a metabehan 
p-group of maximal class of order which has automorphism group of order and 
if n > 7, there is a metabelian p-group of maximal class of order p" with an automorphism 
group of order p2{n-2)+i ^jj-^gy g^jgQ ghow the existence of non- metabelian p-groups (p > 3) 
of maximal class whose automorphism groups have orders p^ and p^. 
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Chapter 8 

An Application of Automorphisms of 
p-Groups 

Given all of the preceding information on the automorphism groups of finite p-groups, we 
would like to consider the connections between these automorphism groups and topics outside 
of group theory. The connection we will explore in this chapter involves a certain Markov 
chain on a finite p-group that has been "twisted" by a simple automorphism of the group. 
In Section 18.11 we bound the convergence rate of this Markov chain. This generalizes results 
of Chung, Diaconis, and Graham |13j . 

There are two appearances of automorphisms of finite j9-groups in other contexts that 
we will mention but will not explore. One is that if we have a group G, a subgroup A of 
Aut(G), and a random walk on G driven by a probability measure constant on the A-orbits 
in G, then the random walk projects to a Markov chain on the A-orbits in G. A classical 
example of this is the fact that a standard random walk on the hypercube projects to the 
Ehrenfest urn model. See Diaconis [20l Section 3 A. 3] for more information. 

Automorphisms of p-groups also arise in supercharacter theory, which has been developed 
recently in the work of Diaconis and Isaacs [22j and Diaconis and Thiem [23], generalizing 
results of Andre, Yan, and others. One way to construct a supercharacter theory on a group 
G uses the action of a subgroup of Aut(G') on G. Neither the projection construction nor 
the supercharacter construction involving automorphisms seems to have been explored in 
general. 



8.1 A Twisted Markov Chain 

We begin this section by reviewing some basic facts about probabilities on groups. Let G 
be a finite group and let P and Q be probabilities on G. The convolution P * Q is the 
probability on G defined by 

{P*Q){g) = J2Pi9h-')Q{h). 

h£G 
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The Fourier transform P of P is defined on representations p of G by 

geG 

Convolution and the Fourier transform are related by the equation P * Q = pQ. The total 
variation distance between P and Q is given by 

IIP - gilTv = max |P(A) - QiA)\ = ^ ^ |P(^) - Q{g)\. 

The Upper Bound Lemma of Diaconis and Shahshahani [23] bounds the total variation 
distance between P and the uniform distribution U using the Fourier transform: 

4||P - Uf^y < \G\ J2 \Pi9) - Ui9)\' = Yl dim(p) ■ Tr(P(p)P(p)*), 

geG l^pelrr(G) 

where * denote complex conjugation. The inequality is an application of the Cauchy-Schwartz 
inequality, the intermediate term is the chi-square distance between P and U, and the 
equality follows from the Plancherel Theorem. When G is abelian, the Upper Bound Lemma 
reduces to 

i^peiTT{G) 

Now we can proceed to discuss certain Markov chains on G. Suppose that a is an automor- 
phism of G and P is a probability on G. Let Xq be the identity element e of G, and define 
random variables Xi, X2, . . . on G by 

where the Qn are independent random variables on G, each with distribution P. Then 

is a Markov chain. Let P^ be the probability distribution induced by Xn- We can express 

P„ as a simple convolution of probabilities by writing 

Xr, = a^-\g,)a--\g2) ■ ■ ■ gn. (8.1) 

Then P„ = ct"^^(P) * cr"^^(P) * ■ ■ ■ * P, where (J^{P) denotes the probability distribution 
given by a\P){g) = P{a^\g)). We would like to know bounds on the distance ||P„ — t/||Tv; 
that is, how fast does P^ converge to the uniform distribution? 

Various cases of this Markov chain have been examined by several authors. Chung, 
Diaconis, and Graham [13j analyze {Xn} when G = Cp, where p is an odd prime, a is 
multiplication by 2, and P(0) = P(l) = P(— 1) = 1/3. They show that the chain converges 
in O(logploglogp) steps. Furthermore, although this is the correct rate of convergence for 
infinitely many p, the correct rate of convergence is O(logp) time for almost all p (although 
no infinite sequence of primes p for which this is true is known). They also discuss some 
other choices of a and P. 
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The motivation in [13] stems from the theory of pseudorandom number generators. The 
Markov chain {X„} on G = Cp when a is the identity automorphism and -P(O) = P(l) = 
P(— 1) = 1/3 takes O(p^) steps to converge. The Markov chain analyzed by Chung, Diaconis, 
and Graham requires the same number of random bits but converges much faster. For the 
general problem, we can view {Xn} as a "twist" of the Markov chain obtained when a is the 
identity automorphism. Intuitively, we might expect that the twisted chain converges faster 
(or at least as fast). If so, it would be interesting to know when the convergence of a Markov 
chain can be sped up by twisting it with an automorphism. 

Diaconis and Graham ^21j analyze {X„} when G = , ex is multiplication by a matrix in a 
specific conjugacy class of GL{d, ¥2), and P is the probability on G satisfying P(l, 0, . . . , 0) = 
6 and P(0, . . . ,0) = 1 — 9 with < < 1. They show that the chain converges in 0{dlogd) 
time. 

Asci [3] examines the case when G = Cp and cr is a general element of GL{d, Fp), general- 
izing the work of Chung, Diaconis, and Graham. Asci shows that the Markov chain converges 
in 0{p^ logp) steps in general, while if a has integer eigenvalues which are all neither 1 nor -1, 
then 0((logp)^) steps suffice. Also, if a has integer eigenvalues and exactly one eigenvalue 
has absolute value 1, then 0{p^) steps are necessary and sufficient for convergence. 

In this section, we sharpen Asci's results in certain cases. In the context of the general 
problem, we consider the group G = Cp, where p is an odd prime. The automorphism a 
will be multiplication by a diagonalizable matrix in GL{d,¥p), and P will satisfy P{0) = 
1 — q and P(efc) = P(— e^) = q/2d, where is the k-th unit vector, k = 1,2,. . . ,d, and 
< g < 1. In Subsection 18.1.11 we prove an upper bound on the convergence rate of 
In Subsection I8.1.2[ we consider a special case of {Xn} and show that in this case, the 
convergence rate is within a constant multiple of the upper bound. Our methods are largely 
direct generalizations of the methods of Chung, Diaconis, and Graham used in [13]. 

Before moving on the statements and proofs, it should be mentioned that Hildebrand [121 
Il3l m] has written several papers generalizing the work of Chung, Diaconis, and Graham 
so that at each step of the Markov chain on G = Cp, the automorphism a is chosen in- 
dependently from a fixed probability distribution on Aut (Cp). Among many other results, 
Hildebrand shows that in all non-trivial cases, the Markov chain converges in 0((logp)^) 
steps, and under more restrictive conditions, the Markov chain converges in O(logploglogp) 
steps. 

8.1.1 An Upper Bound on the Convergence Rate 

For the remainder of this section, let G = C^ and define a probability distribution P on G by 
P(0) = 1 — g and P(efc) = P(— e^) = q/2d, where is the k-th. unit vector, k = 1,2, ... ,d, 
and < g < 1. Suppose A e GL((i, Fp) is diagonalizable (over Fp) and has eigenvalues 
ai,a2, . . . , ad. Let be the Markov chain on G given by Xq = and Xn+i = AXn + gn, 

where the Qn are independent random variables with distribution P, and let P„ be the 
probability distribution on G induced by X„. 

The upper bound we derive for the convergence rate of {Xn} depends on the simpler 
Markov chain that is obtained when d = 1 and is discussed in [13]. Define a Markov chain 
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{Yn} on Cp by 

Yn+i = hYn + Qn and = 0, 

where 6 is a non-zero element of Cp and the are independent random variables with 
distribution Q, where Q(0) = 1 — g and Q{1) = Q(— 1) = q'/2. Write Qn for the measure 
induced by Yn- Write Dn{b,q) for the expression given by the Upper Bound Lemma for 
M\Qn ~ f^llxv- The irreducible characters of Cp are Py{g) = e^'^*^^/^ for y = 0, 1, ... ,p — 1. 
Therefore, 

y=l j=0 

In particular, when 6 = 2, the proof of [131 Theorem 1] directly extends to show that 

^Qn - U\\ly < D„(2, l/8d) < 2e*(i-'')" - 2, 

where t = [log2p], r = 4d{\nd + Int + c), and n = rt. We will apply this result to our 
chain in Corollary 18. 2t analogous results for other b would lead to analogous results for 
Cp. Returning to our chain {X^}, we can bound the convergence rate of {Xn} using the 
expressions Dn{b,q). 

Theorem 8.1. Let p be an odd prime. Then 

AWPn - f/|||v < exp {Dr,{ai, q/8d) + D^{a2, q/8d) + ■■■ + D^{ad, q/8d)) - 1. 

Proof. The matrix A is diagonalizable, so we can choose C G GL{d, ¥p) so that B = CAC^^ 
is a diagonal matrix (with entries ai,a2, . . . ,ad). Define a new Markov chain {Zn} on G 
by = and Zn+i = BZn + hn, where the are independent random variables with 
distribution P. From Equation 18.11 we see that the random variable C~^X„C is identically 
distributed to Z„. Thus ||X„ — [/||xv and — [/||tv are equal, and we may assume that A is 
a diagonal matrix. (Diaconis and Graham |21j were the first to observe that the convergence 
rate of the Markov chain only depends on the conjugacy class of A, or the conjugacy class 
of a in Aut(G) in the general case.) 

The measure P„ is the convolution of the measures fij, given by 

fij{±aiek) = — 

for k = 1, . . . ,d and 
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for J = 0, . . . , n — 1. The Fourier transform of /ij is given by 
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cos 



COS 



COS 



27r ■ a^y 
P 

2tt ■ aly 
P 

27r ■ ajy 
P 



1. 



Finally, the inequalities e ^ < 1 — x/2 for < x < 1 and a — a\ cosx| > ci/4 — (a/4) cos (2x) 
for all X and < a < 1 show that 



< 



< 



^\Pn-U\\%^ 

(d p— 1 n— 1 
EEnii 
j=l j/=l j=0 

d p—1 n~l 



2d 2d 



cos 



— : H : COS 

8d 8d 



2n ■ aly 
P 

2ti ■ aly 
P 



j = l y=l j = 

exp {Dn{ai, q/8d) + D„(a2, q/8d) + ■■■ + Dn{ad, q/8d)) - 1. 



□ 



Corollary 8.2. Let t = [log2p] . When A = 21 and q = 1, if n = Adt{\nt + Inc? + c) for 

OO, then \\Pn - f/||^v < 2e-^ 

Proof. Let r = Ad{lnt + Inci + c). By Theorem 18.11 and the previous comment bounding 

IIQn-f/|||v, 

4||Pn-f/||^v < exp (2(i(e*(i-V«'^)" - 1)) - 1 

< exp(2d(e-'"^'^-^-l)) -1 

< 86-". 



□ 



8.1.2 A Lower Bound on the Convergence Rate 

In this subsection, we will show that when p = 2^ — 1, A = 21, and g = 1, the upper 
bound given by Corollary 18.21 for the rate of convergence of the Markov chain defined 
in Subsection 18.1.11 is correct up to a constant multiple. 

Theorem 8.3. Suppose p = 2* — 1 is prime. For the Markov chain {X„} with A = 21 and 
q = ^, '^f 

dtilnt + lnd- 1) 
n < — ^ ^ 

then 

\\Pn-U\\ly>\ 

for large t. 

Proof. Our proof uses the Second Moment Method developed by Wilson; see [S3] for more 
details. For any function f : Cp —>■ C and any constants > 0, Chebyshev's inequality 
says that 

Pre/ {x : - Eu{f)\ > a^/Vaiuif)] < ^ 
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and 



Prp„ {x : |/(x) - EpM)\ > /^VVeMT)} < ^- 



If X and y denote the complements of the sets in question and they are disjoint, then 

||Pn-f/l|TV>l---4 

a p 

To prove the theorem, it is enough to choose an appropriate function / : Cp — >^ C so that if 
a = l3 = 2 and t is large enough, then X and Y are disjoint. Define / to be the function 

d t-i 

i=l j=0 

where q = ^'^'^Ip . Let n = rt with r to be chosen later. Recall that 



y-z 



The expectation and variance of / under the uniform distribution U and the distribution P„ 

d-l 1 /27r-2"(2^' - 1)' 



on Cp are calculated in Lemma [B.l[ Let 



t-l r 



n 

a=0 

t-l 

n 

a=0 



d d 



- COS 



p 



d-2 1 



- cos 



Then, by Lemma [B. 11 



Euif) 
Euiff) 
Var^(/) 

EpMJ) 
Varp„(/) 



d d 





dt 
dt 

dtui 

t-i 



2tt ■ 2" 
P 



1 

- cos 
d 



2tt ■ 2"2^ 
P 



dtJ2^ + tid^ -d)Y.^'!i 



j=0 

t-i 



j=0 



dt J2 n • + t{d^-d)Y, r • - dh^ul"-. 



j=0 



j=0 



Using this information in the bounds obtained by Chebyshev's inequality (with a = (3 = 2) 
gives 
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and 

Prp„ [x : - dm[\ > 2v/Varp„(/)} < ^. 

Choose r to be an even integer of the form 

d(\nt + \nd) 

r = : — dX. 

-21n|nf| 

Then 

To show that X and Y are disjoint for large enough t, it is enough to show that Ep^{f) — 
2^y\'aTu{f) — ^ oo and A/Varp^ (/) / Ep^ (/) — > as t — > oo. The first fact is proved in 
Lemma IB. 21 and the second fact is proved in Lemma IB. 81 The theorem follows from this and 
the bound —2 In |n^| < Gtt^ obtained from Lemma [B. 21 □ 
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Appendix A 



Numerical Estimates for Theorem 12.1 



The purpose of this section is to prove several estimates needed in Chapters [5] and [61 Most of 
the estimates involve Gaussian coefficients, and so we will begin with the relevant definitions 
and bounds on the Gaussian coefficients obtained by Wilf [96] . 
The Gaussian coefficient (also called the q-hinomial coefficient) 

(g" - 1) ■ ■ ■ (g" - q^-^) 
(g'^ - 1) ■ ■ ■ (g'^ - g'^-i) 

is the number of fc-dimensional subspaces of a vector space of dimension n over Fg. We shall 
be concerned with estimates for [^]^ and for the Galois number 

n 

Qn{q) = 

k=0 

which is the total number of subspaces of a vector space of dimension n over Fg. (A survey 
of these numbers is given by Goldman and Rota [33].) First we need a technical lemma. 

Lemma A.l. Let g > 1 and define 

oo 

C{q) = Yl 

r=—oo 

Let f{x) = —ax^ + hx + c with a > 0. For any pair of integers t < u, set 

u 

A{q) = Y^f^'^- 

r=t 

Then A(q) < C{q"')q^^y^ for some real number y E [t, u]. 
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n 
k 




Proof. Suppose the maximum of f{x) in [t,u] occurs at x = y. The global maximum of 
/(x) occurs at X = b/2a, so one of three cases holds: b/2a <y = t, t<y = b/2a < u, or 
u = y < b/2a. In each case, ii t < r < u, then 

-a{r -yf - f{r) + f{y) 
= —a{r — yY — {—ar"^ + 6r + c) + {—ay"^ + by + c) 
= {2ay-b){r-y) 



> 0. 



Thus 



A{q) = 



u 



r=t 
u 



< qf{y) q-a{r-y) 

T=t 

oo 



r=— oo 



and it suffices to show that 

oo 

g{y)= J2 s-^'-''^" <9{0), 

r=—oo 

where s = q"'. To prove this inequality, define the theta function 

oo 



oo 

e' '"""e' 



where je'^™! < 1. Jacobi's functional equation for this function (see Whittaker and Wat- 
son [951 Section 21.51]) asserts that 

es{z,w) = -^e^y-'-'es{z/w,-l/w), 

\/—lW 

where a/c^ denotes e*^/^ for < ^ < 27r. The function g{y) is related to the theta function 
as follows: 



oo 

9[y) = s ^ 2^ s e > 

r=—oo 

2 

= s~y e3{-iy\ns,w), 
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where iriw = — In s. Applying the functional equation leads to 



yms 




r=oo 



_J_ \ ^ g— r-^TT-^/ In Sg— 2ir7ry 
In e ^—^ 




r=— oo 

oo 



— (1 + 2 ^ g-r^.Vins cos2r7ri/) 



In s 

r=l 



oo 



r=l 

= ^7(0). 

This completes the proof. □ 
For q > 1, define 

oo 

n n 
Sn{q) = ^g'=("-'=) = g"V4^^-(fc-n/2)^. 



Note that both C{q) and D{q) decrease to 1 as g ^ oo. If g > 2, then C{q) < C(2) < 9/4 
and D{q) < D{2) < 7/2. The following estimates on Gaussian coefficients and Galois 
numbers were either obtained by Wilf [96j or follow from his work. 

Lemma A. 2. Let q be a prime power. Then 

< (A.l) 



n 



D{q)q-'l'''l'\2--^-^)^ < Q^^q) (A.2) 

< Sn{q)D{q) 

< C{q)D{q)q'''/^ 

Proof. Equation lA.ll and Qn{,q) < Sn{q)D{q) are proved in [96]. The inequality 5'„(g) < 
C{q)q" follows from Lemma \A.1\ taking /(x) = x{n — x) = —x^ + nx and noting that 
x{n — x) < /A for all x. This proves Qn{q) ^ C{q)D[q)q^ 1^. 

The lower bound for Qnisi) is slightly more complicated, but it is easy to see from [96]. 
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Lemma fA.lt and the definition of S'„(g) that 

25„_i(g) + 2g-2« 



Gn{q) > Sniq) - 



q-1 
2C(g)g("-i)'/4 



q-1 

> g"V4-l/4(2 



2C(g)g(i-")/^ 



2 

where the last inequality uses the fact that 2C{q)/ (g — 1) < 9/2. □ 

Next we will find numerical bounds for dn, the rank of Fn/Fn+i- These are needed for 
Lemma IA.5I and Theorems 12.51 and 12.71 Recall that 



" 1 



% 



Lemma A. 3. For any positive integer n and d > 5, 



10 rf" 
7 n 



Proof. For any i and d, the expression 

counts (for example) the number of infinite d-ary sequences with (minimum) period i. This 
is at most d\ the number of infinite d-ary sequences whose period divides i. Thus 

, ^ , d"" d^ 
dn<d+ — + ■■■ + — . 

2 n 

We will prove the claim by induction on n. When n = 1, this is trivially true. When n = 2, 

d2 < d+ — 

1 A d' 
'^-d)Y 

7 d^ 

< 

- 5 2 

10 d^ 
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and the claim is true. Now suppose n > 2 and assume that 

10 



'•n—l 



7 n-1 

Then 

A ^ A 
"n ^ H 

n 

10 c/"-^ c/" 
7 n — l 

^ lOn \ ti" 



< 1 



Idin — 1) J n 
10 ■ 3 \ 



7- 5 ■ 2/ n 

10 c/" 
7 n 

The claim holds by induction. □ 
Lemma A. 4. Suppose n > 3 and d > 6 or n > 10 and d > 5. Then 

15 

dn - Adn-l - 2dn-2 > "y (A-3) 

and 

2 

dn - 2dn^i • rf„_2 > -1- (A.4) 

n — l 

Suppose n > 10 and d > 5, or n > 5 and d > 6, or n > 4 and d > 8, or n > 3 and d > 17. 
Then 

dn - Un-i - 4rf2 + 11/16 > 0. (A.5) 
Proof. By the definition of dn and Lemma IA.31 

dn — 4dn-i — 2c/„_2 = 3(i„_i — 2dn-2 

n 

^ 30 20 ci"-2 



n 7 n — l 7 n — 2 

To prove Equation IA.3I for given values of n and d, it is certainly sufficient to show that 

rf" 30 c/"-i 20 (^"-2 
n 7 n — l 7 n — 2 

or equivalently that 

1 30 20 

n " 7d{n - 1) ~ 7d{n - 2) " ^ 
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The left-hand side of this equation is obviously increasing as a function of d. Furthermore, 



1 30 20 _ n 1 n-1 30 n-2 20 

n + 1 7dn 7d{n — 1) n + 1 n n 7d{n—l) n — 1 7d{n — 2) 

n 1 n 30 n 20 



> 



> 



n + 1 n n + 1 7d{n - 1) n + 1 7d{n-2) 
n fl 30 20 



n+l\n 7d{n - 1) 7d{n - 2) 



Thus if Equation IA.6I holds for some positive integers d and n, it holds for all larger d and 
n. It turns out that Equation IA.6I holds for the following pairs of values: d = 5 and n = 40; 
d = 6 and n = Q; d = 7 and n = A, and d = 8 and n = 3. This proves Equation IA.3I for 
all values of d and n except: d = 5 and 10 < n < 39; d = 6 and 3 < < 5; and d = 7 
and 77, = 3. A computer check shows that Equation IA.3I in these CclSGS clS well, proving the 
general claim about Equation IA.3[ 
Turning to Equation IA.4[ we find 

2 _(i" 2 

dn ~ 2a„_i - ■ dn-2 — "n-1 - ' "n-2 

n — 2 n n — 2 



ci" 10 ci"-i 20 ci"-2 



> 



n 7 n — 1 7{n — 2) n — 2 
To prove Equation IA.4I for given values of n and rf, it suffices to show that 

rf" 10 d"^-^ 20 



or equivalently that 



n 7 n—1 7{n — 2) n 
1 10 20 



> 0, 



> 0. (A.7) 



n 7d{n-l) 7d'^{n-2f 

As with Equation I A. 6t if this equation holds for some positive integers d and ra, then it holds 
for all larger d and n. In fact, it holds for d = 5 and n = 10 and for d = Q and = 3. This 
proves Equation IA.4[ 



Finally, for Equation IA.51 we have 



dn — ^dn-i — 4(i^ = 3(i„_i — Ad^ 

n 

> Ad^. 

n 7 n — 1 

To prove Equation IA.5I for given values of n and d, it suffices to show that 

rf" 30 . 

- - - 4rf2 > 0, 

n 7 n — 1 
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or equivalently that 

1 30 ^ > 

n 7d{n - 1) rf"-^ 

As with Equations IA.6I and IA.71 if this equation holds for some positive integers d and n, 
then it holds for all larger d and n. In fact, it holds for the following pairs of values: d = 5 
and n = 14; d = 6 and n = 7; d = 7 and n = 5; d = 10 and n = 4, and d = 25 and n = 3. 
The finitely many cases of Equation IA.5I remaining are true by a computer check. □ 

The following lemma is needed in Chapter [5] to bound products of Gaussian coefficients, 
and we will finish this appendix with Lemma IA.6[ which is used in Chapter [HI 

Lemma A. 5. Fix a prime p and integers n > 3 and d > 6 or n > 10 and d > 5. Let F be 
the free group of rank d, and let di be the dimension of Fi/Fi^i for all i. For 1 < i < n — 1 
and < Ui < d^, let 

n-1 

-(uj+i-dj+i)(uj+i-Uj /2) 



where the sum is over all integers "Uj+i, . . . ,Un such that 



< 


Uj 




1 < 


Un-l 


< dn- 


2 < 




< dn. 



Then for 1 < i < n — 2, 
Proof. First note that 

A„_i(m„_i) = ^ p-K-'in)K-n„_i/2)_ 

«n = 2 

As a function of m„, the expression — (u„ — dn){un — u„_i/2) is at most {dn — u„_i/2)^/4, so 
that 

by Lemma lA.ll The proof of the theorem is by backward induction on i. Note that 
When i = n — 2, using our bound on An-i(un~i) gives 

An-2{Un-2) 

dn-l 

< C(p)p'^"^^ pMS^_i/16-u„-id„/4+(c(„-i-ji„-i)(w„-i-u„-2/2) 

U„^l = l 
dn-l 

= C{p)p^"^'^ p-15u2_^/16+{-c(„/4+n„_2/2+d„_i)n„_i-d„_iM„_2/2 
u„-i=l 
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As a function of the polynomial 

-15m^_i/16 + {-dn/4: + u„_2/2 + rf„_i)u„_i - rf„_iM„_2/2 

is maximized at 

u„__i = 8(-(i„/4 + M„_2/2 + rf„_i)/15. 

By Lemma rA.4l Equation IA.3| this is at most 1 when n > 3 and c/ > 6 or n > 10 and c? > 5. 
So as Mn-i ranges from 1 to dn-i-, the polynomial is maximized at Un~i = 1- By Lemma [A. It 

An-2{Un-2) < C'(pl^/l'^)C'(p)/"/^-l^/l^-^"/^+'^"->(l-'^"-)""-=^/l 

This proves the theorem for the base case i = n — 2. By induction, for i < n — 3, 



d 



'i+l 



Mi + 1=0 

< Q(^pyn-i-2^-l5/W+dl/A+dn.i-d„/4: 
di+i 

. ^ ^ p-(Mi+i-di+i)(«i+i--Ui/2)-ni+i((ii+2-l)/2 
«i+i=0 

As a function of Wj+i, the polynomial 

-{Ui+i - c/j+i - Mi/2) - Mi+i((ii+2 - l)/2) 

= + + ?i,;/2 - ((ij+2 - l)/2)ni+i - di+iUi/i 

is maximized at 

Mj+i = {di+i +Ui/i- {di+2 - l)/2))/2. 

By Lemma IA.41 Equation IA.4t this is at most 1/2 when n > 3 and > 6 or n > 10 and 
d> 5. So as Mj+i ranges from to (ij+i, the polynomial is maximized at Uj+i = 0. Thus 

and the result is proved by induction. □ 

Lemma A. 6. Suppose that ai, . . . ,ar are positive integers with n = ai + ■ ■ ■ + ar- Then 

+ + (n-r + 1)2 + (r-1), (A.8) 

and this bound is achieved when a\= a2 = ■ ■ ■ = C(r-i = 1- Furthermore, if n > e + 1 and 
r > 2, then 

aj + ■ ■ ■ + + er < {n - if + 1 + 2e. (A.9) 



86 



Proof. For Equation IA.8| we use a simple induction argument. It is clearly true for r = 1. 
Suppose it is true up through r; we will prove it for r + 1. 

al + \- al + a^j^^ < {n - a^+i - r + 1)^ + (r - 1) + a^^^ 

< {n-r + 1- ar+iY + a^^^ + (r - 1) 

< (n-r + 1 -l)2 + l2 + (r-l) 
= (n — r)^ + r, 

proving Equation IA.8I As for Equation IA.9t 

af-l \-al + er < {n - r + 1^ + {r - 1) + er 

= {{n-1) - {r -2)^ + r -1 + er 
= {n- 1)2 - 2(n - l)(r - 2) + (r - 2)2 + r - 1 + er 
< (n - 1)2 - (e + r - l)(r - 2) + (r - 2)2 + r - 1 + er 
= (n-l)2 + l + 2£, 

where the first inequality follows from Equation IA.8I and the second inequality follows from 
the fact that since n > e + 1 and n > r, we know that n > + r + l)/2. □ 
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Appendix B 

Numerical Estimates for Theorem 18.1 



This appendix contains numerical estimates used in the proof of Theorem 18. 3[ All of the 
following results assume that p = 2* — 1 is prime, q = e^'^*/^, and n = rt. Let G = Cp 
and define a probability distribution on G by P{ek) = P{—ek) = l/2d, where is the fc-th 
unit vector and k = 1,2, ... ,d. Let be the Markov chain on G given by Xq = and 

Xn+i = 2Xn + gn, where the gn are independent random variables with distribution P, and 
let Pn be the probability distribution on G induced by X„. The function / : — *^ C is 
defined by 

d t-1 
i=l j=0 

Finally, Ilj and Tj are defined by the product formulas 



and 



Lemma B.l. 



t-1 

n 

a=0 



t-1 

n 

a=0 



d-l 1 f2n- 2^(2^-1] 
d d 



d-2 1 
d d 



2tt ■ 2° 
P 



P 



1 /27r-2"2-' 

+ - cos 

d \ p 



Euif) 


= 




Euiff) 


= dt 




Var^(/) 


= dt 




EpM) 


= dtui 






t-1 




EpMI) 


= dtY,^ + t{d^ 






j=0 


j=0 




t-1 




Varp„(/) 


= dtY,^ + tid^ 

j=0 


j=0 



T2r 
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d t-1 



yeC^ 1=1 j=0 
d p t—1 



i=l yi=0 j=0 

f-1 p 



^ i=0 y=0 



21 y 



d t-1 



E E E 



pa 



pa 



pa 



i,i'=l j,j'=0 
d t-1 



E E E 



2i 2/,, 



j,j'=i yecrf j,j'=o 

d E E ^'^'^^^-'^'^^ + - ^) E E 

yGC^j,j'=0 yeC^j,j'=0 

y=o j,j'=o 

y=0 Z=0 j,j'=0 



'p-1 t-1 

EE""" 

.2/=0 j=0 



dt 

E 

EEE^'-fe)?"" 

d t-1 

i=l 3=0 
d t-1 N-1 

EEn 

i=l j=0 k=0 



d-1 1 

+ -; COS 



d d 

90 



271 ■ 

P 



d-1 1 



t-i t-i 

= "En 

j=Q a=0 

= dtU[. 

d t-l 



27r • 2«2^' 
P 



E E E Pn{y)f'^^-'' 



i,i' = ljJ' = Oy(zCd 

d t-l 



t-l 



t-l 



d J2 Pn{{2' - 2^')ei) + {d^ - c^) E - 2^'e2) 

i,i'=o j,j'=Q 

^^En,^+(^'-^) - En 

j=0 j,j'=0 a=0 



'd-2 1 



27r • 2"2^' 



P 



1 /27r-2'^2^ 
+ - cos 



d 



P 



t-l t-l t-l 

dtJ2^ + t(d^-d)J2]l 

j=0 j=0 0=0 



d-2 1 /27r-2« 
+ - cos 



d d 



+ COS 

d 



P 



277 ■ 2"^ 

p 



t-l 



t-l 



j=0 j=0 



□ 



Lemma B.2. |ni|'^ is bounded away from and 1 independent of d and t, in particular, 



,-37r2 



Thus dtll\ - 2(^1/2^1/2 ^g^^^ yjj^g^ x>l. 
Proof. 



t-l 



|ni| 



- n 

a=0 
t-l 

s n 



d- 1 1 
(i d 



d-1 1 



27r-2'^ 



a=0 



d d 
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+.11-^ 



1 /27r-2'' 



P 




a=0 
t-1 



d d \ p 



T-f I d-1 I I [271 -2" 
hi/ n^.A-^" 



a=0 
t-1 

^ n 



dp^ 

a=0 ^ ^ 

t-1 

7r2(2")2/p^ 



e 

a=0 

2 *-l 



= exp 

= exp 
= exp 



TT^ ■ (4* - 1) 



3p2 



< exp(^-^-(l-l/(p + l)2) 
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For the following lemmas, let 

G{x,y) = 



d-2 1 1 

— ; h - COS ZTTX + - COS 2ny 

da d 



and for convenience write G{x) = G{x,0). 

Lemma B.3. llljl < |ni| and \Tj\ < |ni| for all j > 1. 

Proof. This follows from Fact 1 in [13J in the case of 11^ and is obvious in the case of Tj. □ 
Lemma B.4. There exists a constant C2 independent of d and t so that for k >2, 



Proof. 



,=k+l ^ ^ ^ 



d-1 1 



< 



n ^(2-^+ 

b=k+l ^ 

e 

n 

b=k+l 
oo 

n 



p 



d d 



cos 2n ■ [ 2 



P 



b=k+l 
oo 



d-1 1 



n h 



b=k+l 
oo 



d d 
2d 



^ I 1 - - ( 27r ■ ( 2- 



P 



P 



-1 



< 



< 



n 1 



b=k+l 



2t^ 
d 



exp 



< exp 

< 1 + 



2t^ 
d 

2t^ 
d 
47r^ 
d-A^' 



b=k+l 



-1 



□ 



Lemma B.5. There exists a constant cq independent of d and t so that for t^^^ < j <t/2, 



1 < 



< 1 + 



Co 
d-2^' 
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Proof. 



G 



6=1 



t 



G 



p 



b=l 
3 



2-6 2^-^\ ( . 2"^ 
p P ) \ p 



. TT ^^2-^ + — -2^-^-^Vf2-' + — 1 
fei^.+i V P P J \ P J 

b=i ^ ^ ^ b=t-j+i ^ ^ 



6=1 
t-j 

b=i 



2-b 2J-^\ / , 2-^ 

G 2-^ + — 

p P J \ p 



2-j-b 2-^\ ( , 2"''^ 

+ 2-^ + — G 2-^ + — 

P P ) \ P 

b\ -1 * 



(B.l) 



b=j+l ^ ^ 6=t_j+l ^ -f^ 

Note that by Equation IB. 11 it follows that |nj/n^| > 1. It follows from Lemma [B.4I that 



2- 



fe=j+i 



p 



IK-'-?)"" 



< 1 



< 1 + 



C2 



fe=t-i+l 



_C2_ 



Furthermore (using the fact that G(x) > (rf — 2)/(i), 
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It follows that there is an absolute constant Cq independent of d and t such that 
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Lemma B.6. There exists a constant Ci independent of d and t so that for t^^^ < J < t/2, 
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Furthermore (using the fact that G{x) > {d — 2)/d), 
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For the lower bound, we have 
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and similarly, 
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It follows that there is an absolute constant independent of d and t such that 
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Lemma B.8. 

as t oo. 
Proof. Note that 
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By Lemmas IB.5I and IB.61 
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Then, using Lemma IB .71 and Lemma IB.31 it follows that 
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This proves the lemma. 
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